Code

Fix iceberg full refresh#247#252

Code

Merged

menuetb merged 87 commits intoaws-samples:mainaws-samples/dbt-glue:mainfrom sanga8:fix-iceberg-full-refresh#247sanga8/dbt-glue:fix-iceberg-full-refresh#247Copy head branch name to clipboardDec 14, 2023

+1,652-291

Commits

Commits on Oct 30, 2023

• first commit

  

  Vincent.PAUWELS

  committed
  4e26166

  Copy full SHA for 4e26166

• revert pr template

  

  Vincent.PAUWELS

  committed
  caeca5e

  Copy full SHA for caeca5e

• fix when existing_relation_type is none

  

  Vincent.PAUWELS

  committed
  80fa1d7

  Copy full SHA for 80fa1d7

Commits on Oct 31, 2023

• Fixed unit tests test_glue_session.py and test_glue_session_demo.py

  moomindani

  committed
  fa85d32

  Copy full SHA for fa85d32

• Added debug logs and fixed some tests

  moomindani

  committed
  199d622

  Copy full SHA for 199d622

Commits on Nov 1, 2023

• Fix single_functional test

  aajisaka

  committed
  036955b

  Copy full SHA for 036955b

• Merge pull request aws-samples#1 from aajisaka/fix_unit_tests

  Show description for 78106a4
  moomindani

  authored
  78106a4

  Copy full SHA for 78106a4

• Bump dbt-tests-adapter from 1.6.6 to 1.6.7

  Show description for 048b9c7
  dependabot[bot]

  authored
  048b9c7

  Copy full SHA for 048b9c7

• Fixed functional_test

  moomindani

  committed
  c095ac6

  Copy full SHA for c095ac6

Commits on Nov 2, 2023

• Merge pull request aws-samples#256 from aws-samples/dependabot/pip/dbt-tests-adapter-1.6.7

  Show description for 6a51320
  menuetb

  authored
  6a51320

  Copy full SHA for 6a51320

• Bump dbt-tests-adapter from 1.6.7 to 1.7.0

  Show description for fdf8cdf
  dependabot[bot]

  authored
  fdf8cdf

  Copy full SHA for fdf8cdf

Commits on Nov 7, 2023

• Fixed functional/adapter/test_basic.py

  moomindani

  committed
  bb2ffe3

  Copy full SHA for bb2ffe3

• Fixed exception handling and cursor issue

  moomindani

  committed
  df43bc1

  Copy full SHA for df43bc1

• Renamed functional_test/adapter/test_basic.py to test_basic_functional_test.py to avoid basename conflict

  moomindani

  committed
  cefed9e

  Copy full SHA for cefed9e

• Updated README

  moomindani

  committed
  398333d

  Copy full SHA for 398333d

• Merge pull request aws-samples#257 from aws-samples/dependabot/pip/dbt-tests-adapter-1.7.0

  Show description for 07b6100
  menuetb

  authored
  07b6100

  Copy full SHA for 07b6100

• Merge pull request aws-samples#253 from moomindani/fix_unit_tests

  Show description for 03f2d24
  menuetb

  authored
  03f2d24

  Copy full SHA for 03f2d24

• Update to version 1.7

  menuetb

  committed
  4f2a5e5

  Copy full SHA for 4f2a5e5

Commits on Nov 8, 2023

• Added CI

  moomindani

  committed
  f028c83

  Copy full SHA for f028c83

• Bump dbt-tests-adapter from 1.7.0 to 1.7.1

  Show description for 3c26eec
  dependabot[bot]

  authored
  3c26eec

  Copy full SHA for 3c26eec

• Bump black from 23.10.1 to 23.11.0

  Show description for 7cd2241
  dependabot[bot]

  authored
  7cd2241

  Copy full SHA for 7cd2241

• now correctly delete the table

  

  Vincent.PAUWELS

  committed
  7f401c7

  Copy full SHA for 7f401c7

• cleaner

  

  Vincent.PAUWELS

  committed
  7295153

  Copy full SHA for 7295153

Commits on Nov 9, 2023

• Update CI

  moomindani

  committed
  60713bd

  Copy full SHA for 60713bd

• Update CI

  moomindani

  committed
  9b34097

  Copy full SHA for 9b34097

• Update CI

  moomindani

  committed
  fd06f6b

  Copy full SHA for fd06f6b

• Update CI

  moomindani

  committed
  4985298

  Copy full SHA for 4985298

• Update CI

  moomindani

  committed
  fe8d07a

  Copy full SHA for fe8d07a

• Update CI

  moomindani

  committed
  5c587b3

  Copy full SHA for 5c587b3

• Update CI

  moomindani

  committed
  5b0ba6f

  Copy full SHA for 5b0ba6f

• Update CI

  moomindani

  committed
  4d6cb7b

  Copy full SHA for 4d6cb7b

• Increased timeout for integ test

  moomindani

  committed
  b7eea76

  Copy full SHA for b7eea76

• Update unit tests and CI

  moomindani

  committed
  b3b694f

  Copy full SHA for b3b694f

• Added unit test for Lake Formation

  moomindani

  committed
  8cc9cfe

  Copy full SHA for 8cc9cfe

• Added test for Glue default version

  moomindani

  committed
  71309d2

  Copy full SHA for 71309d2

• Renamed test class

  moomindani

  committed
  513f285

  Copy full SHA for 513f285

• Merge pull request aws-samples#258 from moomindani/main

  Show description for 1b1578f
  menuetb

  authored
  1b1578f

  Copy full SHA for 1b1578f

• Merge branch 'main' into dependabot/pip/black-23.11.0

  menuetb

  authored
  edefa82

  Copy full SHA for edefa82

• Merge pull request aws-samples#260 from aws-samples/dependabot/pip/black-23.11.0

  Show description for 095f61f
  menuetb

  authored
  095f61f

  Copy full SHA for 095f61f

• Merge branch 'main' into dependabot/pip/dbt-tests-adapter-1.7.1

  menuetb

  authored
  9c44859

  Copy full SHA for 9c44859

• Merge pull request aws-samples#259 from aws-samples/dependabot/pip/dbt-tests-adapter-1.7.1

  Show description for bb5eb01
  menuetb

  authored
  bb5eb01

  Copy full SHA for bb5eb01

• Updated dependency for 1.7.1

  moomindani

  committed
  ed34068

  Copy full SHA for ed34068

• Configured concurrency control for tests

  moomindani

  committed
  290da5f

  Copy full SHA for 290da5f

• Configured concurrency control for tests

  moomindani

  committed
  63b37cc

  Copy full SHA for 63b37cc

• Configured concurrency control for tests

  moomindani

  committed
  ac68fa0

  Copy full SHA for ac68fa0

• Merge pull request aws-samples#261 from moomindani/main

  Show description for aac8117
  menuetb

  authored
  aac8117

  Copy full SHA for aac8117

• Change requirements

  menuetb

  committed
  9fb45f9

  Copy full SHA for 9fb45f9

• Merge pull request aws-samples#262 from aws-samples/change_requierments

  Show description for 9f43ee6
  menuetb

  authored
  9f43ee6

  Copy full SHA for 9f43ee6

• fix spark version

  menuetb

  committed
  ea7b809

  Copy full SHA for ea7b809

• Merge pull request aws-samples#263 from aws-samples/change_requierments

  Show description for 2e16ac7
  menuetb

  authored
  2e16ac7

  Copy full SHA for 2e16ac7

• Update tox.ini

  dataders

  authored
  f91b38e

  Copy full SHA for f91b38e

• Add integration test for all PR

  menuetb

  committed
  c2bb5a9

  Copy full SHA for c2bb5a9

• Add labeled based functional test

  menuetb

  committed
  7f167ee

  Copy full SHA for 7f167ee

• Merge pull request aws-samples#265 from aws-samples/integration_test

  Show description for bf23d5e
  menuetb

  authored
  bf23d5e

  Copy full SHA for bf23d5e

Commits on Nov 10, 2023

• Remove unnecessary extra_py_files for Delta Lake

  aajisaka

  committed
  170d977

  Copy full SHA for 170d977

• Added unit test for test_hudi_merge_table with Mock using moto and mock_glue

  moomindani

  committed
  3ad6d2a

  Copy full SHA for 3ad6d2a

• Moved S3Url util class to util.py

  moomindani

  committed
  e61215e

  Copy full SHA for e61215e

• Renamed util.py for unit tests

  moomindani

  committed
  befb4d1

  Copy full SHA for befb4d1

• Update CHANGELOG

  aajisaka

  committed
  fc45930

  Copy full SHA for fc45930

• Fix unit test

  moomindani

  committed
  1317e89

  Copy full SHA for 1317e89

• Fixed test_generic_tests

  moomindani

  committed
  c6ed306

  Copy full SHA for c6ed306

• Merge pull request aws-samples#268 from moomindani/refine_tests

  Show description for d095ec8
  menuetb

  authored
  d095ec8

  Copy full SHA for d095ec8

• [minor][doc] Fix Iceberg config in README

  aajisaka

  committed
  203892f

  Copy full SHA for 203892f

• Merge pull request aws-samples#267 from aajisaka/fix-delta-py-file

  Show description for f5c40fc
  menuetb

  authored
  f5c40fc

  Copy full SHA for f5c40fc

• Merge pull request aws-samples#269 from aajisaka/fix-iceberg-doc

  Show description for d98dc06
  menuetb

  authored
  d98dc06

  Copy full SHA for d98dc06

• fix test generic (aws-samples#270)

  menuetb

  authored
  8c663b6

  Copy full SHA for 8c663b6

• fix test generic (aws-samples#271)

  menuetb

  authored
  bdc6070

  Copy full SHA for bdc6070

• Fix test generic (aws-samples#272)

  Show description for 975167f
  menuetb

  authored
  975167f

  Copy full SHA for 975167f

Commits on Nov 13, 2023

• beauty

  

  Vincent.PAUWELS

  committed
  25b6bfe

  Copy full SHA for 25b6bfe

• duplicate line of code

  

  Vincent.PAUWELS

  committed
  4d12ac1

  Copy full SHA for 4d12ac1

• Fix test generic (aws-samples#276)

  Show description for 3c054d0
  menuetb

  authored
  3c054d0

  Copy full SHA for 3c054d0

• Migrate snapshot test and docs test from functional_test to functional/adapter (aws-samples#275)

  Show description for ef5cdf0
  moomindani

  authored
  ef5cdf0

  Copy full SHA for ef5cdf0

• use drop_relation instead of glue__drop_relation

  

  Vincent.PAUWELS

  committed
  7c9c412

  Copy full SHA for 7c9c412

Commits on Nov 14, 2023

• Bump mypy from 1.6.1 to 1.7.0 (aws-samples#273)

  Show description for 5c827a6
  dependabot[bot]

  authored
  5c827a6

  Copy full SHA for 5c827a6

• Update moto requirement from ~=4.2.7 to ~=4.2.8 (aws-samples#277)

  Show description for 87359dd
  dependabot[bot]

  authored
  87359dd

  Copy full SHA for 87359dd

• all basic tests enabled (aws-samples#278)

  Show description for acadda6
  

  3 peopleauthored
  acadda6

  Copy full SHA for acadda6

Commits on Nov 15, 2023

• Revert the change in get_result_from_cursor to fix test (aws-samples#279)

  aajisaka

  authored
  879f41a

  Copy full SHA for 879f41a

• Fix integ tests (aws-samples#280)

  Show description for bbbc05a
  

  moomindani

  and

  aajisaka

  authored
  bbbc05a

  Copy full SHA for bbbc05a

Commits on Nov 20, 2023

• first commit

  

  Vincent.PAUWELS

  committed
  97ca609

  Copy full SHA for 97ca609

• revert pr template

  

  Vincent.PAUWELS

  committed
  4249e08

  Copy full SHA for 4249e08

• fix when existing_relation_type is none

  

  Vincent.PAUWELS

  committed
  20949b7

  Copy full SHA for 20949b7

• now correctly delete the table

  

  Vincent.PAUWELS

  committed
  bef16ed

  Copy full SHA for bef16ed

• cleaner

  

  Vincent.PAUWELS

  committed
  0e4e7c1

  Copy full SHA for 0e4e7c1

• beauty

  

  Vincent.PAUWELS

  committed
  a5cd470

  Copy full SHA for a5cd470

• duplicate line of code

  

  Vincent.PAUWELS

  committed
  3e43a6e

  Copy full SHA for 3e43a6e

• use drop_relation instead of glue__drop_relation

  

  Vincent.PAUWELS

  committed
  b611bb5

  Copy full SHA for b611bb5

• Merge branch 'fix-iceberg-full-refresh#247' of https://github.com/sanga8/dbt-glue into fix-iceberg-full-refresh#247

  

  Vincent.PAUWELS

  committed
  9083b21

  Copy full SHA for 9083b21