Skip to content

feat(python): add pyarrow to delta compatible schema conversion in writer/merge #4563

feat(python): add pyarrow to delta compatible schema conversion in writer/merge

feat(python): add pyarrow to delta compatible schema conversion in writer/merge #4563

Re-run triggered November 11, 2023 17:56
Status Failure
Total duration 22m 22s
Artifacts

python_build.yml

on: pull_request
lint
2m 35s
lint
Python Build (Python 3.7 PyArrow 8.0.0)
22m 9s
Python Build (Python 3.7 PyArrow 8.0.0)
Python Build (Python 3.10 PyArrow latest)
9m 11s
Python Build (Python 3.10 PyArrow latest)
Python Benchmark
5m 47s
Python Benchmark
PySpark Integration Tests
10m 29s
PySpark Integration Tests
Matrix: multi-python-running
Fit to window
Zoom out
Zoom in

Annotations

1 error and 27 warnings
Python Benchmark
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: b669358587d39aa3960fcb02d004c488f6f90a4f | Previous: 9b938308490a60808443ee36b4f7b2c3055a6c15 | Ratio | |-|-|-|-| | `tests/test_benchmark.py::test_benchmark_read` | `7.285255782729618` iter/sec (`stddev: 0.020149064419840938`) | `18.983776516789153` iter/sec (`stddev: 0.0044833427348284095`) | `2.61` | | `tests/test_benchmark.py::test_benchmark_read_pyarrow` | `10.547295359161197` iter/sec (`stddev: 0.0067932036069230555`) | `24.433018221308377` iter/sec (`stddev: 0.001650282025229822`) | `2.32` | This comment was automatically generated by [workflow](https://github.com/delta-io/delta-rs/actions?query=workflow%3Apython_build) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
lint
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/setup-python@v2, actions-rs/toolchain@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
lint
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
lint
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
lint
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
lint
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Benchmark
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions-rs/toolchain@v1, actions/cache@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Python Benchmark
Performance alert! Previous value was 18.983776516789153 and current value is 7.285255782729618. It is 2.6057803710601313x worse than previous exceeding a ratio threshold 2
Python Benchmark
Performance alert! Previous value was 24.433018221308377 and current value is 10.547295359161197. It is 2.3165197701689735x worse than previous exceeding a ratio threshold 2
Python Benchmark
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Benchmark
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Benchmark
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Benchmark
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.10 PyArrow latest)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Python Build (Python 3.10 PyArrow latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.10 PyArrow latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.10 PyArrow latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.10 PyArrow latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
PySpark Integration Tests
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions/setup-java@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
PySpark Integration Tests
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
PySpark Integration Tests
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
PySpark Integration Tests
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
PySpark Integration Tests
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.7 PyArrow 8.0.0)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Python Build (Python 3.7 PyArrow 8.0.0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.7 PyArrow 8.0.0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.7 PyArrow 8.0.0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Python Build (Python 3.7 PyArrow 8.0.0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/