Code

[write] Transaction append data API#393

Code

Merged

zachschuermann merged 24 commits intodelta-io:maindelta-io/delta-kernel-rs:mainfrom zachschuermann:transaction-data-pathzachschuermann/delta-kernel-rs:transaction-data-pathCopy head branch name to clipboardNov 8, 2024

+955-72

Commits

Commits on Oct 28, 2024

• wip: rough append data path

  zachschuermann

  committed
  f4eabf0

  Copy full SHA for f4eabf0

Commits on Oct 29, 2024

• fix cherry pick

  zachschuermann

  committed
  59fd679

  Copy full SHA for 59fd679

• clean

  zachschuermann

  committed
  5926d96

  Copy full SHA for 5926d96

• add partition test

  zachschuermann

  committed
  3c7dd37

  Copy full SHA for 3c7dd37

• more cleanup

  zachschuermann

  committed
  cc01511

  Copy full SHA for cc01511

• use filemeta in parquet metadata

  zachschuermann

  committed
  a6290f2

  Copy full SHA for a6290f2

• materialize write_metadata as vec

  zachschuermann

  committed
  c7dac51

  Copy full SHA for c7dac51

• modify write_json_files to take iterator of DeltaResult

  zachschuermann

  committed
  8f1a446

  Copy full SHA for 8f1a446

• get_parquet_handler

  zachschuermann

  committed
  b41d255

  Copy full SHA for b41d255

Commits on Oct 30, 2024

• comments

  zachschuermann

  committed
  9838e35

  Copy full SHA for 9838e35

Commits on Oct 31, 2024

• address comments

  zachschuermann

  committed
  bdea457

  Copy full SHA for bdea457

• unify read test code in common

  zachschuermann

  committed
  51e7cfb

  Copy full SHA for 51e7cfb

• make a set_value helper for tests

  zachschuermann

  committed
  c67862e

  Copy full SHA for c67862e

Commits on Nov 1, 2024

• add invalid schema test

  zachschuermann

  committed
  b2f8414

  Copy full SHA for b2f8414

• fmt

  zachschuermann

  committed
  9a2ae28

  Copy full SHA for 9a2ae28

Commits on Nov 7, 2024

• fix naming, add test

  zachschuermann

  committed
  edd6c4b

  Copy full SHA for edd6c4b

• fmt

  zachschuermann

  committed
  1d4c914

  Copy full SHA for 1d4c914

• address comments

  zachschuermann

  committed
  92d29a6

  Copy full SHA for 92d29a6

• add write_parquet test

  zachschuermann

  committed
  4675231

  Copy full SHA for 4675231

• fix comment

  zachschuermann

  committed
  a7455f8

  Copy full SHA for a7455f8

• comments, cleanup, test fix

  zachschuermann

  committed
  0044d8e

  Copy full SHA for 0044d8e

• address feedback

  zachschuermann

  committed
  59166c2

  Copy full SHA for 59166c2

Commits on Nov 8, 2024

• address feedback, add test for disallowing non-trailing slash in parquet write

  zachschuermann

  committed
  cab14d6

  Copy full SHA for cab14d6

• Merge remote-tracking branch 'upstream/main' into transaction-data-path

  zachschuermann

  committed
  796f2c4

  Copy full SHA for 796f2c4