[WIP] Add support for spark-connect #96

Job	Run time
Run test on pyspark 3.0.3, pin_mode false, python 3.10, joblib 1.2.0	1m 28s
Run test on pyspark 3.1.3, pin_mode false, python 3.10, joblib 1.2.0	1m 28s
Run test on pyspark 3.2.3, pin_mode false, python 3.10, joblib 1.2.0	1m 33s
Run test on pyspark 3.3.2, pin_mode false, python 3.10, joblib 1.2.0	1m 38s
Run test on pyspark 3.4.0, pin_mode false, python 3.10, joblib 1.2.0	1m 44s
Run test on pyspark 3.2.3, pin_mode true, python 3.10, joblib 1.2.0	1m 34s
Run test on pyspark 3.3.2, pin_mode true, python 3.10, joblib 1.2.0	1m 36s
Run test on pyspark 3.4.0, pin_mode true, python 3.10, joblib 1.2.0	1m 58s
Run test on pyspark 3.0.3, pin_mode false, python 3.10, joblib 1.3.0	1m 18s
Run test on pyspark 3.1.3, pin_mode false, python 3.10, joblib 1.3.0	1m 23s
Run test on pyspark 3.2.3, pin_mode false, python 3.10, joblib 1.3.0	1m 28s
Run test on pyspark 3.3.2, pin_mode false, python 3.10, joblib 1.3.0	1m 28s
Run test on pyspark 3.4.0, pin_mode false, python 3.10, joblib 1.3.0	1m 43s
Run test on pyspark 3.2.3, pin_mode true, python 3.10, joblib 1.3.0	1m 28s
Run test on pyspark 3.3.2, pin_mode true, python 3.10, joblib 1.3.0	1m 30s
Run test on pyspark 3.4.0, pin_mode true, python 3.10, joblib 1.3.0	1m 42s
Run test on pyspark 3.5.1, pin_mode , python 3.11, joblib 1.3.0	1m 37s
Run test on pyspark 3.5.1, pin_mode , python 3.11, joblib 1.4.2	1m 41s
Run test on pyspark 3.5.1, pin_mode , python 3.12, joblib 1.3.0	1m 40s
Run test on pyspark 3.5.1, pin_mode , python 3.12, joblib 1.4.2	1m 45s
	31m 42s

Provide feedback