feat: lakefs integration

[ion-elgreco]

Description

Makes LakeFS first-class citizen in delta-rs. Operations are executed in a transaction branch, where we write into and then try to commit and merge if there is no conflict. If there is a conflict it means there was a concurrent writer, so we remove the log, and retry with the conflict checker.

Main concepts that this PR introduces through out the core crate:

• LogStore makes distinction between reading and writing objectstore, the writing store can receive an optional operation_id
• Every operation has customExecuteHandler which implements a pre_execute and post_execute.
  • pre-execute is executed usually right away, or after sanity checks are done in the operation
  • post-execute is executed after commitbuilder has finished
• CommitBuilder also uses operation_id to pass it to commit_entry functions

[github-actions]

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

[codecov]

Codecov Report

Attention: Patch coverage is 66.47824% with 593 lines in your changes missing coverage. Please review.

Project coverage is 72.16%. Comparing base (fb75965) to head (c087382).
Report is 11 commits behind head on main.

Files with missing lines	Patch %	Lines
crates/lakefs/src/logstore.rs	44.49%	105 Missing and 16 partials ⚠️
python/src/lib.rs	0.00%	119 Missing ⚠️
crates/lakefs/src/client.rs	85.87%	43 Missing and 6 partials ⚠️
crates/core/src/storage/mod.rs	41.02%	21 Missing and 2 partials ⚠️
crates/core/src/operations/transaction/mod.rs	68.57%	18 Missing and 4 partials ⚠️
crates/lakefs/src/execute.rs	93.56%	4 Missing and 16 partials ⚠️
crates/core/src/operations/set_tbl_properties.rs	0.00%	19 Missing ⚠️
crates/core/src/operations/add_column.rs	0.00%	18 Missing ⚠️
crates/core/src/operations/create.rs	50.00%	12 Missing and 5 partials ⚠️
crates/lakefs/src/errors.rs	31.57%	13 Missing ⚠️
... and 23 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3103      +/-   ##
==========================================
- Coverage   72.43%   72.16%   -0.27%     
==========================================
  Files         128      134       +6     
  Lines       41366    42962    +1596     
  Branches    41366    42962    +1596     
==========================================
+ Hits        29962    31004    +1042     
- Misses       9498     9958     +460     
- Partials     1906     2000      +94     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.