-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
GH-37650: [Python] Check filter inputs in FilterMetaFunction #38075
Conversation
|
@github-actions autotune |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for noticing this. The fix LGTM on the principle, just two minor suggestions.
cpp/src/arrow/compute/kernels/vector_selection_filter_internal.cc
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, thank you @p-a-a-a-trick . I fixed the C++ formatting and improved the test slightly.
CI failures are unrelated. |
After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit 11d5ab6. There were no benchmark performance regressions. 🎉 The full Conbench report has more details. It also includes information about 22 possible false positives for unstable benchmarks that are known to sometimes produce them. |
…pache#38075) ### Rationale for this change Prevent a segfault upon passing a non-(chunked_)array object into `Table.filter`. See apache#37650. ### What changes are included in this PR? 1. Check filter Datum kind to make sure that it is an array or a chunked array 2. test that attempting to filter a table with another table raises a not implemented error ### Are these changes tested? In PyArrow, yes ### Are there any user-facing changes? Raises an error if a non-array or non-chunked_array object is passed into `Table.filter` * Closes: apache#37650 Lead-authored-by: Patrick Clarke <[email protected]> Co-authored-by: Antoine Pitrou <[email protected]> Signed-off-by: Antoine Pitrou <[email protected]>
…pache#38075) ### Rationale for this change Prevent a segfault upon passing a non-(chunked_)array object into `Table.filter`. See apache#37650. ### What changes are included in this PR? 1. Check filter Datum kind to make sure that it is an array or a chunked array 2. test that attempting to filter a table with another table raises a not implemented error ### Are these changes tested? In PyArrow, yes ### Are there any user-facing changes? Raises an error if a non-array or non-chunked_array object is passed into `Table.filter` * Closes: apache#37650 Lead-authored-by: Patrick Clarke <[email protected]> Co-authored-by: Antoine Pitrou <[email protected]> Signed-off-by: Antoine Pitrou <[email protected]>
…pache#38075) ### Rationale for this change Prevent a segfault upon passing a non-(chunked_)array object into `Table.filter`. See apache#37650. ### What changes are included in this PR? 1. Check filter Datum kind to make sure that it is an array or a chunked array 2. test that attempting to filter a table with another table raises a not implemented error ### Are these changes tested? In PyArrow, yes ### Are there any user-facing changes? Raises an error if a non-array or non-chunked_array object is passed into `Table.filter` * Closes: apache#37650 Lead-authored-by: Patrick Clarke <[email protected]> Co-authored-by: Antoine Pitrou <[email protected]> Signed-off-by: Antoine Pitrou <[email protected]>
Rationale for this change
Prevent a segfault upon passing a non-(chunked_)array object into
Table.filter
. See #37650.What changes are included in this PR?
Are these changes tested?
In PyArrow, yes
Are there any user-facing changes?
Raises an error if a non-array or non-chunked_array object is passed into
Table.filter