You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
cudf-polars supports chunked parquet scans using the libcudf reader. This feature request proposes doing the same thing for parquet sinks.
Describe the solution you'd like
Enable libcudf’s chunked Parquet writer as the default sinking strategy in cudf-polars. The GPU engine config should allow enabling/disabling chunked writing;. And we could reuse the same config option currently used for chunked parquet scans.
Is your feature request related to a problem? Please describe.
cudf-polars supports chunked parquet scans using the libcudf reader. This feature request proposes doing the same thing for parquet sinks.
Describe the solution you'd like
Enable libcudf’s chunked Parquet writer as the default sinking strategy in cudf-polars. The GPU engine config should allow enabling/disabling chunked writing;. And we could reuse the same config option currently used for chunked parquet scans.
Additional context
xref #18567
The text was updated successfully, but these errors were encountered: