[DRC-575] [Bug] Advanced Diffs Return Errors in dbt-athena

[tkrishna-equip]

Current Behavior

All Advanced Diffs run for a long time and return errors

Expected Behavior

Advanced Diffs should run quickly and without errors

Steps To Reproduce

Configure this environment:
dbt core: version 1.6.15
dbt-athena: version 1.6.3
python: 3.9.6

Select Advanced Diffs and try running

Relevant log output

No response

Environment

• recce: 0.20.0
• OS: MacOS 14.5
• Python: 3.9.6
• Data Warehouse:
• dbt: 1.6.15

Additional Context

_DRC-575

[popcornylu]

For value diff, it seems a issue from audit helper
dbt-labs/dbt-audit-helper#87

Please see the workaround solution a paste in the issue.

[popcornylu]

The problem for top-k and histogram, it is fixed in #395 and will be available at the next release. I will updated the release number here once it is releaased.

For valude diff and profile diff. I found that there are compatibility issues with audit-helper and dbt-profiler on AWS Athena.

Just created a PR in audit-helper
dbt-labs/dbt-audit-helper#108
and created a PR in dbt-profiler
data-mie/dbt-profiler#91
A current walk-around solution is to put
https://github.com/DataRecce/recce/blob/main/macros/recce_athena.sql in marcros folder of your dbt project.

[popcornylu]

The upstreams' PRs aren't merged. I close this issue first, please use the workaround solution mentioned above.