Skip to content

feat(python): add pyarrow to delta compatible schema conversion in writer/merge #4536

feat(python): add pyarrow to delta compatible schema conversion in writer/merge

feat(python): add pyarrow to delta compatible schema conversion in writer/merge #4536

Re-run triggered November 9, 2023 18:50
Status Failure
Total duration 9m 0s
Artifacts

python_build.yml

on: pull_request
lint
2m 36s
lint
Python Build (Python 3.7 PyArrow 8.0.0)
8m 49s
Python Build (Python 3.7 PyArrow 8.0.0)
Python Build (Python 3.10 PyArrow latest)
2m 44s
Python Build (Python 3.10 PyArrow latest)
Python Benchmark
6m 40s
Python Benchmark
PySpark Integration Tests
3m 46s
PySpark Integration Tests
Matrix: multi-python-running
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 27 warnings
Python Benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: d98881c2f7ed10b92dca1d75c2f5d649c81bd5f2 | Previous: e362eef98351d16c2b95e33f2fc0731b75b68c4b | Ratio | |-|-|-|-| | `tests/test_benchmark.py::test_benchmark_read` | `7.265822807032052` iter/sec (`stddev: 0.019530629257121596`) | `19.410515133584063` iter/sec (`stddev: 0.006825618917932335`) | `2.67` | | `tests/test_benchmark.py::test_benchmark_read_pyarrow` | `9.64578210743217` iter/sec (`stddev: 0.00821524842269282`) | `25.086099553658897` iter/sec (`stddev: 0.0013000877117260435`) | `2.60` | This comment was automatically generated by [workflow](https://github.com/delta-io/delta-rs/actions?query=workflow%3Apython_build) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
Python Build (Python 3.7 PyArrow 8.0.0)
Process completed with exit code 2.
lint
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/setup-python@v2, actions-rs/toolchain@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
lint
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
lint
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
lint
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
lint
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.10 PyArrow latest)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Python Build (Python 3.10 PyArrow latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.10 PyArrow latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.10 PyArrow latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.10 PyArrow latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
PySpark Integration Tests
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions/setup-java@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
PySpark Integration Tests
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
PySpark Integration Tests
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
PySpark Integration Tests
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
PySpark Integration Tests
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Benchmark
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions-rs/toolchain@v1, actions/cache@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Python Benchmark
Performance alert! Previous value was 19.410515133584063 and current value is 7.265822807032052. It is 2.6714820398314783x worse than previous exceeding a ratio threshold 2
Python Benchmark
Performance alert! Previous value was 25.086099553658897 and current value is 9.64578210743217. It is 2.6007325558732877x worse than previous exceeding a ratio threshold 2
Python Benchmark
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Benchmark
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Benchmark
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Benchmark
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.7 PyArrow 8.0.0)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Python Build (Python 3.7 PyArrow 8.0.0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.7 PyArrow 8.0.0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.7 PyArrow 8.0.0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.7 PyArrow 8.0.0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/