Code

Feat: Iceberg cache#355

Code

Open

aaronsteers wants to merge 31 commits intomainairbytehq/PyAirbyte:mainfrom feat/iceberg-hack-dayairbytehq/PyAirbyte:feat/iceberg-hack-dayCopy head branch name to clipboard

+880-21

Commits

Commits on Aug 2, 2024

• add back iceberg file

  aaronsteers

  committed
  73f9289

  Copy full SHA for 73f9289

• updates!

  aaronsteers

  committed
  d26f29e

  Copy full SHA for d26f29e

• add polars schema utils

  aaronsteers

  committed
  ca37196

  Copy full SHA for ca37196

• poetry add polars

  aaronsteers

  committed
  07ac6a5

  Copy full SHA for 07ac6a5

• add polars type mapping

  aaronsteers

  committed
  80e0fdb

  Copy full SHA for 80e0fdb

• add as_filelike() for iterator

  aaronsteers

  committed
  8d9ef08

  Copy full SHA for 8d9ef08

• lint fix

  aaronsteers

  committed
  015faf0

  Copy full SHA for 015faf0

• wip: iceberg updates, w example script

  aaronsteers

  committed
  4fb9b3b

  Copy full SHA for 4fb9b3b

Commits on Aug 3, 2024

• custom pydantic classes with str data

  aaronsteers

  committed
  bddbc59

  Copy full SHA for bddbc59

• refactor to parse stdout in separate method

  aaronsteers

  committed
  9af597f

  Copy full SHA for 9af597f

Commits on Aug 4, 2024

• make flush_active_batch public

  aaronsteers

  committed
  46ba395

  Copy full SHA for 46ba395

• cleanup

  aaronsteers

  committed
  e99e72f

  Copy full SHA for e99e72f

• add icerberg processor methods

  aaronsteers

  committed
  4d163a0

  Copy full SHA for 4d163a0

• update parquet writer

  aaronsteers

  committed
  6337bd2

  Copy full SHA for 6337bd2

• remove dupe implementation

  aaronsteers

  committed
  852a4b8

  Copy full SHA for 852a4b8

• refactor: remove unnecessary RecordProcessor class

  aaronsteers

  committed
  049b38a

  Copy full SHA for 049b38a

Commits on Aug 5, 2024

• refactor: add AirbyteWritersInterface and WriteMethod, plus related refactoring

  aaronsteers

  committed
  a671c97

  Copy full SHA for a671c97

• Merge branch 'refactor/writers-write-not-sources' into feat/iceberg-hack-day

  aaronsteers

  committed
  b06485a

  Copy full SHA for b06485a

• fix circular import loop

  aaronsteers

  committed
  34acdda

  Copy full SHA for 34acdda

• Merge branch 'refactor/writers-write-not-sources' into feat/iceberg-hack-day

  aaronsteers

  committed
  41f14e1

  Copy full SHA for 41f14e1

• fix parquet writer import

  aaronsteers

  committed
  ed8edec

  Copy full SHA for ed8edec

Commits on Aug 7, 2024

• updated polars test script

  aaronsteers

  committed
  a5efbd1

  Copy full SHA for a5efbd1

• poetry add --dev boto3

  aaronsteers

  committed
  c3d4e9e

  Copy full SHA for c3d4e9e

• gitignore test-artifact files

  aaronsteers

  committed
  c6969de

  Copy full SHA for c6969de

• update transforms

  aaronsteers

  committed
  63b18ef

  Copy full SHA for 63b18ef

Commits on Sep 2, 2024

• Merge remote-tracking branch 'origin/main' into feat/iceberg-hack-day

  aaronsteers

  committed
  8f82437

  Copy full SHA for 8f82437

• Merge remote-tracking branch 'origin/main' into feat/iceberg-hack-day

  aaronsteers

  committed
  de810e8

  Copy full SHA for de810e8

• remove dupe file

  aaronsteers

  committed
  9abcea4

  Copy full SHA for 9abcea4

• remove dupe import

  aaronsteers

  committed
  80b7340

  Copy full SHA for 80b7340

• remove import

  aaronsteers

  committed
  30d1afb

  Copy full SHA for 30d1afb

• remove extra imports

  aaronsteers

  committed
  54c9752

  Copy full SHA for 54c9752