PySpark development setup Prerequisites JDK 9.0.1 Python 3.6 Pytest 4.3.1 Spark 2.2.1 Airflow 1.10.4 pip install -r requirements.txt Running the tests python -m pytest tests/test_ExtractCCLinks.py