wr.athena.to_iceberg deletes existent tabel when param mode == "overwrite" #2789
gabrieloqm
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, hope you are all doing great!
When using the method wr.athena.to_iceberg (in awswrangler version 3.7.2), I realize that when assigning mode = 'overwrite' when calling this method, the specified athena table in the specified database gets deleted first, and there is a need to specify a value to the table_location param so that the table gets created again (although this didn't seem to be necessary when reading the docs). Is there a way to overwrite the files in the inputed table without deleting the table at all (only its previous data)?
And if there is not, is there a way to save the files with overwrite mode in iceberg Athena table with another method? I have tried with to_parquet. It indeed creates a file on the desired path, but it does not populate the table right away.
Thank you in advance!
Beta Was this translation helpful? Give feedback.
All reactions