Skip to content

Commit

Permalink
[Spark] CI - Use Python packages compatible to Python 3.9 + Run CI wh…
Browse files Browse the repository at this point in the history
…en workflow files change (#2353)

- [X] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)

## Description

Use Python packages compatible to both Python 3.8 and 3.9

https://setuptools.pypa.io/en/stable/history.html#v41-1-0
https://pypi.org/project/pandas/1.1.3/

## How was this patch tested?


## Does this PR introduce _any_ user-facing changes?

---------

Signed-off-by: Felipe Fujiy Pessoto <[email protected]>
Signed-off-by: Felipe Pessoto <[email protected]>
  • Loading branch information
felipepessoto authored Mar 8, 2024
1 parent 3369968 commit 77d43ed
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions .github/workflows/spark_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ jobs:
with:
PATTERNS: |
**
.github/workflows/**
!kernel/**
!connectors/**
- name: install java
Expand Down Expand Up @@ -56,9 +57,9 @@ jobs:
pipenv run pip install cryptography==37.0.4
pipenv run pip install twine==4.0.1
pipenv run pip install wheel==0.33.4
pipenv run pip install setuptools==41.0.1
pipenv run pip install setuptools==41.1.0
pipenv run pip install pydocstyle==3.0.0
pipenv run pip install pandas==1.0.5
pipenv run pip install pandas==1.1.3
pipenv run pip install pyarrow==8.0.0
pipenv run pip install numpy==1.20.3
if: steps.git-diff.outputs.diff
Expand Down

0 comments on commit 77d43ed

Please sign in to comment.