actually check arrow. depend on >=53

[nicklan]

This fixes three issues:

1. The integration test was not enabling enough features to actually test arrow enough. Change it so it does
2. The above caught that we actually don't support arrow 52.x because the various min/max_opt functions don't exist there. See https://docs.rs/parquet/53.1.0/parquet/file/statistics/struct.ValueStatistics.html#method.max and note the deprecation since 53 note.
3. Parquet depends on object_store. So we also need to be flexible on object_store. Right now I'm locking it to the 0.11 series (the latest).

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 78.85%. Comparing base (cd53bc1) to head (408ce2c).
Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #413   +/-   ##
=======================================
  Coverage   78.85%   78.85%           
=======================================
  Files          51       51           
  Lines       10640    10640           
  Branches    10640    10640           
=======================================
  Hits         8390     8390           
  Misses       1781     1781           
  Partials      469      469           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[zachschuermann]

lgtm

[scovich]

LGTM, but did delta-rs sort out the polars dependency that prevented them from upgrading to arrow-53?

[nicklan]

LGTM, but did delta-rs sort out the polars dependency that prevented them from upgrading to arrow-53?

See delta-io/delta-rs#2886 for all the fun they are having with upgrading.