Validation Exception: Found new conflicting delete files that can apply to records matching true

[Jasonlaradsouza]

Apache Iceberg version

1.6.1

Query engine

Spark

Please describe the bug 🐞

I'm getting Validation Exception : Found new conflicting delete files that can apply to records matching true. while trying to write concurrently to the same iceberg table.

The statement I'm using is MERGE INTO.

I have already set the table properties to
"commit.retry.max-wait-ms" : "50000",
"write.merge.isolation-level" : "snapshot",
"write.delete.isolation-level" : "snapshot",
"commit.retry.num-retries" : "3",
"write.update.isolation-level" : "snapshot",
"commit.retry.min-wait-ms" : "50000"

These settings are not working. I'm not sure retries are happening as well. Please help resolve this issue.

Willingness to contribute

• I can contribute a fix for this bug independently
• I would be willing to contribute a fix for this bug with guidance from the Iceberg community
• I cannot contribute a fix for this bug at this time