Code

adds csv writer#1185

Code

Merged

rudolfix merged 26 commits intodeveldlt-hub/dlt:develfrom rfix/adds-csv-writerdlt-hub/dlt:rfix/adds-csv-writerCopy head branch name to clipboardApr 7, 2024

+2,508-955

Commits

Commits on Mar 27, 2024

• bumps for prerelease 0.4.8a1

  rudolfix

  committed
  44ba39f

Commits on Apr 2, 2024

• Merge branch 'devel' of github.com:dlt-hub/dlt into devel

  rudolfix

  committed
  259e85c

Commits on Apr 3, 2024

• requires password and database in motherduck credentials

  rudolfix

  committed
  2cdb296

• identifies data writer by both file format and source item format, adds csv writer for arrow and object(wip)

  rudolfix

  committed
  f9ab06e

• adds postgres csv writer via COPY

  rudolfix

  committed
  e8ad1f9

• improves arrow and parquet tests, adds arrow normalization edge cases

  rudolfix

  committed
  9ac63fb

• refactors extractors in extract, disables schema caches when processing multiple arrows

  rudolfix

  committed
  45ed7ff

• refactors item normalizers, adds arrow normalization, improves logging

  rudolfix

  committed
  fae59cd

• removes internal file formats from loader file formats, renames, tests improvements

  rudolfix

  committed
  7b4a0ed

• Merge branch 'devel' into rfix/adds-csv-writer

  rudolfix

  authored
  496162b

Commits on Apr 4, 2024

• Merge branch 'devel' into rfix/adds-csv-writer

  rudolfix

  committed
  f8c8597

• adds simple csv and postgres docs

  rudolfix

  committed
  3bef4da

• closes writers on exceptions, passes metrics on exceptions, fixes some edge cases with empty arrow files

  rudolfix

  committed
  912fb82

Commits on Apr 5, 2024

• fixes empty tables writer tests and bugs

  rudolfix

  committed
  f94e1e5

• fixes closing writers when exception during flush, missing tzdata on windows handling

  rudolfix

  committed
  4b19c49

• installs tzdata on windows ci

  rudolfix

  committed
  76403c1

• adds csv to docs index

  rudolfix

  committed
  0adb113

• fixes athena sql job client tests setup

  rudolfix

  committed
  7eb6ca8

• adjusts for timezone for the preferred precision, all other precision use timestamp w/o tz

  rudolfix

  committed
  d30d17b

Commits on Apr 6, 2024

• generates create table statements for synapse outside of a job

  rudolfix

  committed
  cb6dc6f

• fixes athena table undefinded detection

  rudolfix

  committed
  60f20c9

• generates all timestamps with timezones in parquet. tests workarounds in duckdb

  rudolfix

  committed
  04e46e9

Commits on Apr 7, 2024

• Merge branch 'devel' into rfix/adds-csv-writer

  rudolfix

  committed
  1b3a029

• fixes quoting in regular csv writer and force nulls in postgres copy job

  rudolfix

  committed
  67f2fb5

• finalizes the docs

  rudolfix

  committed
  5039b2f

• renames jobs in tests so it is possible to select them as required

  rudolfix

  committed
  ce00e74