Releases: dbt-labs/dbt-athena
Releases · dbt-labs/dbt-athena
v1.6.4
What's Changed
Features
- feat(persist_docs): write dbt model and project metadata to properties by @roslovets in #449
- feat: lf_inherited_tags config to exclude certain tags from CRUD by @dacreify in #453
- feat: Implement insert condition for merge strategy. by @talhasenSC in #475
- feat: Implement force_batch flag to allow dbt-athena to skip the attempt to create tables with partition limitations by @Danya-Fpnk in #472
- feat: allow aws session token in profiles file by @benjamin-awd in #459
Fixes
- fix(docs): generate docs for Federated Data Sources with capitalized table names by @roslovets in #456
- fix: in swap_table we need to use get_partitions pagination by @nicor88 in #465
- fix: add 'CatalogId' Parameter to Glue Paginator Call (Related to PR #370) by @brunofaustino in #467
- fix: bug when setting pre-hook=MSCK REPAIR TABLE by @binhnq94 in #469
- fix(ci): make flake 8 working in the pre-commit by @nicor88 in #476
Chore
Dependencies
- chore: Update pre-commit requirement from ~=3.4 to ~=3.5 by @dependabot in #462
- chore: Update moto requirement from ~=4.2.5 to ~=4.2.6 by @dependabot in #460
- chore: Update dbt-tests-adapter requirement from ~=1.6.5 to ~=1.6.6 by @dependabot in #461
- chore: Update black requirement from ~=23.9 to ~=23.10 by @dependabot in #470
- chore: Update moto requirement from ~=4.2.6 to ~=4.2.7 by @dependabot in #477
New Contributors
- @benjamin-awd made their first contribution in #459
- @dacreify made their first contribution in #453
- @binhnq94 made their first contribution in #469
- @talhasenSC made their first contribution in #475
- @Danya-Fpnk made their first contribution in #472
Full Changelog: v1.6.3...v1.6.4
v1.6.3
What's Changed
Features
- feat: Implement update condition for merge strategy by @svdimchenko in #431
- feat: add config for s3_tmp_table_dir by @hiro-o918 in #434
Fixes
- fix: wrong num_retries counting the first run by @Jrmyy in #440
- fix: insert_overwrite updates for tables with int partitions by @artem-garmash in #450
Dependencies
- chore: Update dbt-tests-adapter requirement from ~=1.6.3 to ~=1.6.4 by @dependabot in #430
- chore: Update moto requirement from ~=4.2.4 to ~=4.2.5 by @dependabot in #429
- chore: Update pyupgrade requirement from ~=3.13 to ~=3.15 by @dependabot in #438
- chore: Update dbt-tests-adapter requirement from ~=1.6.4 to ~=1.6.5 by @dependabot in #439
Chore
- chore: md lint pre commit by @svdimchenko in #432
- chore: make use of new features introduced by Python 3.8 by @Jrmyy in #441
- chore: add python 3.12 support by @Jrmyy in #445
- chore: release v1.6.3 by @nicor88 in #451
Full Changelog: v1.6.2...v1.6.3
v1.6.2
What's Changed
Features
- feat: support quoted columns in constraint by @hiro-o918 in #404
Fixes
- fix: Invalid merge when unique_key == merge_update_columns by @artem-garmash in #406
- fix: improve get_partition_batches to treat integers properly by @nicor88 in #425
- fix: current timestamp for views by @svdimchenko in #423
Dependencies
- chore: add AthenaConfig to impl.py by @SoumayaMauthoorMOJ in #412
- chore: Update moto requirement from ~=4.2.2 to ~=4.2.3 by @dependabot in #415
- chore: Update pyupgrade requirement from ~=3.10 to ~=3.11 by @dependabot in #416
- chore: Update moto requirement from ~=4.2.3 to ~=4.2.4 by @dependabot in #421
- chore: Update dbt-tests-adapter requirement from ~=1.6.2 to ~=1.6.3 by @dependabot in #420
- chore: Update pyupgrade requirement from ~=3.11 to ~=3.13 by @dependabot in #422
- chore: bump version to 1.6.2 for release by @svdimchenko in #426
New Contributors
- @artem-garmash made their first contribution in #406
- @SoumayaMauthoorMOJ made their first contribution in #412
Full Changelog: v1.6.1...v.1.6.2
v1.6.1
What's Changed
Features
- feat: Implement configurable debug_query_state parameter for AthenaCursor by @svdimchenko in #395
- feat: Implement default lf tags for database by @svdimchenko in #398
- feat: Implement non-partitioned tmp table by @svdimchenko in #405
- feat: add support for S3 Extra arguments in Seed file upload to s3 by @linkerzx in #397
Dependencies
- chore: improve setup.py to add minimum python version by @nicor88 in #383
- chore: Update moto requirement from ~=4.1.14 to ~=4.2.0 by @dependabot in #387
- chore: Update dbt-tests-adapter requirement from ~=1.6.0 to ~=1.6.1 by @dependabot in #388
- chore: Update pre-commit requirement from ~=2.21 to ~=3.4 by @dependabot in #393
- chore: Update moto requirement from ~=4.2.0 to ~=4.2.2 by @dependabot in #394
- chore: Update black requirement from ~=23.3 to ~=23.9 by @dependabot in #408
- chore: Update dbt-tests-adapter requirement from ~=1.6.1 to ~=1.6.2 by @dependabot in #407
- chore: Bump version for release by @svdimchenko in #409
Fixes
- fix: add varbinary column type for iceberg tables by @sashakcc in #384
- fix: avoid calling cancel method not implemented in PyAthena's connection by @keshihoriuchi in #385
- fix: Mark list_relations_without_caching as available by @voroninman in #391
- fix: Added null check for partitions batches by @lukas-gust in #392
- fix: Athena query in debug log by @svdimchenko in #401
- fix: render relation in case of we hit partition limits by @nicor88 in #403
- fix: Use importlib.metadata.version() to remove implicit dependency on
setuptools
by @skirino in #399 - fix: cross account catalog_id glue client function calls by @brunofaustino in #370
New Contributors
- @keshihoriuchi made their first contribution in #385
- @voroninman made their first contribution in #391
- @lukas-gust made their first contribution in #392
- @skirino made their first contribution in #399
- @linkerzx made their first contribution in #397
Full Changelog: v1.6.0...v1.6.1
v1.6.0
What's Changed
Dependencies
- chore: bump dbt-core to 1.6.0 by @nicor88 in #376
- chore: Update pyupgrade requirement from ~=3.3 to ~=3.10 by @dependabot in #363
- chore: bump flake after dropping python 3.7 support by @nicor88 in #380
Fixes
- fix: docs generate support federated query catalogs by @maiarareinaldo in #324
- fix: add back rowcounts and byte scanned to dbt cli and run_results.json by @nicor88 in #375
Full Changelog: v1.5.2...v1.6.0
v1.5.2
What's Changed
Features
- feat: add data_scanned_in_bytes to adapter response by @jurgispods in #353
- feat: add catalog_name param to AthenaConnection handle by @brunofaustino in #358
- feat: add iceberg sync column types support by @sashakcc in #304
- feat: fix athena partitions limit by @svdimchenko 🔥 in #360
Dependencies
- chore: Update moto requirement from ~=4.1.11 to ~=4.1.12 by @dependabot in #343
- chore: Update pytest requirement from ~=7.3 to ~=7.4 by @dependabot in #346
- chore: Update dbt-tests-adapter requirement from ~=1.5.1 to ~=1.5.2 by @dependabot in #344
- chore: Update dbt-tests-adapter requirement from ~=1.5.2 to ~=1.5.4 by @dependabot in #362
- chore: Update moto requirement from ~=4.1.12 to ~=4.1.14 by @dependabot in #361
- chore: Update pydantic requirement from ~=1.10 to >=1.10,<3.0 by @dependabot in #349
- chore: Update pyparsing requirement from ~=3.1.0 to ~=3.1.1 by @dependabot in #369
Fixes
- fix: fix unexpected error rendering columns missing data_type by @hiro-o918 in #342
- fix: enable persist_docs for views by @roslovets in #337
- fix: remove create_schema from default snapshot materialization by @C123R in #365
- fix: failure when config from view to Iceberg table by @brabster in #367
New Contributors
- @brunofaustino made their first contribution in #358
- @sashakcc made their first contribution in #304
- @C123R made their first contribution in #365
Full Changelog: v1.5.1...v1.5.2
v1.5.1
What's Changed
Features
- feat: LF tags CRUD by @svdimchenko in #305
- feat: AWS LakeFormation data cell filters support by @svdimchenko in #263
- feat: add support for incremental_predicates by @chrischin478 in #294
- feat: Add Athena query state logging by @svdimchenko in #340
- feat: enable mypy pre-commit check by @svdimchenko in #329
Fixes
- fix: handle how edge cases in functional tests triggering by @nicor88 in #307
- fix: yet another fix on functional tests trigger by @nicor88 in #308
- fix: Lakeformation tags in athena__create_csv_table macro by @svdimchenko in #336
- fix: don't error if values aren't set for threads and poll_interval by @brabster in #310
- fix: functional test edge case github ref by @nicor88 in #314
- fix: seprate jobs for pr and main by @nicor88 in #316
- fix: functional tests add fetch secrets by @nicor88 in #320
- fix: athena list schemas argument by @krisstinkou in #322
- fix: BatchDeletePartitions only accepts up to 25 partitions by @juliansteger-sc in #328
- fix: implement native_iceberg_drop by @brabster in #292
- fix: seed-by-insert by @brabster in #330
Others
- chore: Update pyparsing requirement from ~=3.0.9 to ~=3.1.0 by @dependabot in #339
- docs: fix typo of example config by @hiro-o918 in #311
- chore: trim regions for functional testing by @nicor88 in #321
- chore: Update dbt-tests-adapter requirement from ~=1.5.0 to ~=1.5.1 by @dependabot in #325
- chore: Update pytest-cov requirement from ~=4.0 to ~=4.1 by @dependabot in #323
- chore: Update moto requirement from ~=4.1.10 to ~=4.1.11 by @dependabot in #326
- chore: add svdimchenko as code owner by @nicor88 in #318
- chore: Update moto requirement from ~=4.1.9 to ~=4.1.10 by @dependabot in #319
- chore: add reusable workflow for functional tests by @nicor88 in #317
New Contributors
- @brabster made their first contribution in #310
- @krisstinkou made their first contribution in #322
Full Changelog: v1.5.0...v1.5.1
v1.5.0
The migration guide is available here.
Breaking changes
- feat!: remove table_hive_ha and replace it by table materialization with ha config by @Jrmyy in #284
- feat!: rework snapshots and add tests by @BrechtDeVlieger in #202
- chore: support for dbt 1.5 by @Jrmyy in #266
Fixes
- fix: source freshness (cast_timestamp for models without config field) by @roslovets in #287
- fix: functional test trigger fix by @nicor88 in #297
- fix: functional tests remove conditions by @nicor88 in #298
- fix: ha=true for tables was broken for first runs by @nicor88 in #299
Internal
- feat: use relation object whenever possible by @Jrmyy in #273
- ci: init integration tests by @mattiamatrix in #293
- chore: Update pytest-xdist requirement from ~=3.2 to ~=3.3 by @dependabot in #296
- chore: Update moto requirement from ~=4.1.8 to ~=4.1.9 by @dependabot in #295
- chore: Update pyathena requirement from ~=2.25 to >=2.25,<4.0 by @dependabot in #288
- chore: make functional testing triggerable via label by @nicor88 in #300
- chore: improve functional tests trigger by @nicor88 in #301
- chore: release 1.5.0 by @Jrmyy in #303
New Contributors
- @roslovets made their first contribution in #287
Full Changelog: v1.4.5...v1.5.0
v1.4.5
What's Changed
Features
- feat: use glue api to delete table instead of athena drop by @chrischin478 in #249
Fixes
Others
- docs: add chrischin478 as a contributor for code, and bug by @allcontributors in #282
- chore: add classifiers to setup.py by @nicor88 in #278
- chore: release 1.4.5 by @Jrmyy in #281
New Contributors
- @chrischin478 made their first contribution in #249
Full Changelog: v1.4.4...v1.4.5
v1.4.4
What's Changed
Features
- feat: delete condition when using incremental merge with iceberg by @Jrmyy in #233
- feat: add iceberg high availability on table using rename by @Jrmyy in #246
- feat: allow aws credentials in profiles file by @Jrmyy in #260
- feat: improve merge by @aartaria in #100
Fixes
- fix: Iceberg CTAS failed when WG config is enforced by @Gatsby-Lee in #231
- fix: correctly get current_timestamp for both iceberg and hive by @BrechtDeVlieger in #235
- fix: use table as default type when building the catalog by @nicor88 in #241
- fix: add
__dbt_tmp
suffix to seed s3 artifacts by @aartaria in #242 - fix: use identifier for seed tables by @Jrmyy in #243
- fix: check for database in _get_one_catalog (#247) by @maiarareinaldo in #258
- fix: get data catalog method by @svdimchenko in #265
Internal
- test: add dbt basic functional tests by @BrechtDeVlieger in #236
- chore: Update moto requirement from ~=4.1.7 to ~=4.1.8 by @dependabot in #251
- chore: Update dbt-tests-adapter requirement from ~=1.4.5 to ~=1.4.6 by @dependabot in #254
- chore: add contributing section by @nicor88 in #256
- chore: Update dbt-core requirement from ~=1.4.5 to ~=1.4.6 by @dependabot in #252
- chore: remove file requirements.txt to keep it consistent with adapter template by @Jrmyy in #264
- chore: release 1.4.4 by @Jrmyy in #270
Documentation
- docs: add Gatsby-Lee as a contributor for bug by @allcontributors in #232
- docs: add Jrmyy as a contributor for code by @allcontributors in #234
- docs: add nicor88 as a contributor for bug by @allcontributors in #237
- docs: add Jrmyy as a contributor for bug by @allcontributors in #238
- docs: add BrechtDeVlieger as a contributor for bug by @allcontributors in #239
- docs: add aartaria as a contributor for bug by @allcontributors in #245
- docs: add maiarareinaldo as a contributor for bug by @allcontributors in #261
- chore: Update pyathena requirement from ~=2.24 to ~=2.25 by @dependabot in #250
- docs: add henriblancke as a contributor for code, and bug by @allcontributors in #272
- docs: add svdimchenko as a contributor for code, and bug by @allcontributors in #271
New Contributors
- @BrechtDeVlieger made their first contribution in #235
- @aartaria made their first contribution in #242
- @maiarareinaldo made their first contribution in #258
Full Changelog: v.1.4.3...v1.4.4