feat/support ndjson in pipeline #1942

Job	Run time
embedders_int_test	3m 50s
api_based_int_test (partitioners)	4m 32s
api_based_int_test (chunkers)	6m 42s
check_untagged_tests	6s
setup (3.9)	4s
setup (3.10)	5s
src_e2e_test (3.9)	1m 24s
dest_e2e_test (3.9)	59s
src_e2e_test (3.10)	1m 18s
src_api_test	34s
dest_e2e_test (3.10)	46s
sql_connectors_int_test	3m 23s
vector_db_connectors_int_test	4m 43s
blob_storage_connectors_int_test	2m 0s
nosql_connectors_int_test	6m 4s
uncategorized_connectors_int_test	4m 56s
	41m 26s

Provide feedback