[WIP] Add support for spark-connect #95

Job	Run time
Run test on pyspark 3.0.3, pin_mode false, python 3.10, joblib 1.2.0	1m 35s
Run test on pyspark 3.1.3, pin_mode false, python 3.10, joblib 1.2.0	1m 37s
Run test on pyspark 3.2.3, pin_mode false, python 3.10, joblib 1.2.0	1m 32s
Run test on pyspark 3.3.2, pin_mode false, python 3.10, joblib 1.2.0	1m 35s
Run test on pyspark 3.4.0, pin_mode false, python 3.10, joblib 1.2.0	2m 3s
Run test on pyspark 3.2.3, pin_mode true, python 3.10, joblib 1.2.0	1m 39s
Run test on pyspark 3.3.2, pin_mode true, python 3.10, joblib 1.2.0	1m 33s
Run test on pyspark 3.4.0, pin_mode true, python 3.10, joblib 1.2.0	1m 46s
Run test on pyspark 3.0.3, pin_mode false, python 3.10, joblib 1.3.0	1m 21s
Run test on pyspark 3.1.3, pin_mode false, python 3.10, joblib 1.3.0	1m 24s
Run test on pyspark 3.2.3, pin_mode false, python 3.10, joblib 1.3.0	1m 31s
Run test on pyspark 3.3.2, pin_mode false, python 3.10, joblib 1.3.0	1m 30s
Run test on pyspark 3.4.0, pin_mode false, python 3.10, joblib 1.3.0	1m 39s
Run test on pyspark 3.2.3, pin_mode true, python 3.10, joblib 1.3.0	1m 27s
Run test on pyspark 3.3.2, pin_mode true, python 3.10, joblib 1.3.0	1m 27s
Run test on pyspark 3.4.0, pin_mode true, python 3.10, joblib 1.3.0	1m 38s
Run test on pyspark 3.5.1, pin_mode , python 3.11, joblib 1.3.0	1m 46s
Run test on pyspark 3.5.1, pin_mode , python 3.11, joblib 1.4.2	1m 45s
Run test on pyspark 3.5.1, pin_mode , python 3.12, joblib 1.3.0	1m 40s
Run test on pyspark 3.5.1, pin_mode , python 3.12, joblib 1.4.2	1m 47s
	32m 15s

Provide feedback