Code

Sync from soda-core#8

Code

Open

bichitra95 wants to merge 187 commits intoatlanhq:mainatlanhq/soda-core:mainfrom sodadata:mainsodadata/soda-core:mainCopy head branch name to clipboard

+22,733-2,235

Commits

Commits on Sep 13, 2023

• Catch exceptions while building results file (#1936)

  m1n0

  authored
  5164d34

Commits on Sep 14, 2023

• [pre-commit.ci] pre-commit autoupdate (#1935)

  Show description for 71dfe19
  

  pre-commit-ci[bot]

  and

  vijaykiran

  authored
  71dfe19

Commits on Sep 18, 2023

• Reference check: support must NOT exist (#1937)

  m1n0

  authored
  8fa452e

Commits on Sep 19, 2023

• Bump to 3.0.49

  m1n0

  committed
  995b4ac

Commits on Sep 21, 2023

• Add thresholds and diagnostics to scan result (#1939)

  m1n0

  authored
  67597f2

Commits on Sep 27, 2023

• Fix databricks numeric types profiling (#1941)

  m1n0

  authored
  8e74d93

• Bump to 3.0.50

  m1n0

  committed
  67111aa

Commits on Oct 2, 2023

• Allow to specify virtual file name for add sodacl string (#1943)

  m1n0

  authored
  f743fc7

Commits on Oct 6, 2023

• Feature/add more file formats for duckdb (#1942)

  Show description for 3fdac3c
  

  3 peopleauthored
  3fdac3c

Commits on Oct 10, 2023

• added BigQuery Job Labels (#1947)

  Show description for b34e271
  

  m1n0

  and

  data-bytekid

  authored
  b34e271

Commits on Oct 11, 2023

• Bump to 3.0.51

  m1n0

  committed
  d25316f

Commits on Oct 13, 2023

• Distribution: compute value counts in DB rather than in python

  Show description for 2f67adb
  

  baturayo

  and

  pre-commit-ci[bot]

  authored
  2f67adb

Commits on Oct 17, 2023

• Fix 3.8 compatibility

  m1n0

  committed
  fe27fc3

Commits on Oct 25, 2023

• feat: Add Dask/Pandas configurable data source naming support (#1951)

  Show description for 431a0ee
  

  dirkgroenen

  and

  pre-commit-ci[bot]

  authored
  431a0ee

• Bump to 3.0.52

  dirkgroenen

  committed
  5312c43

Commits on Oct 31, 2023

• Freshness: support mixed thresholds (#1957)

  Show description for f6505f0
  m1n0

  authored
  f6505f0

Commits on Nov 1, 2023

• Add License to every package (#1958)

  m1n0

  authored
  7affe19

• Bump to 3.0.53

  m1n0

  committed
  b3c112e

Commits on Nov 3, 2023

• Failed rows check: support thresholds (#1960)

  m1n0

  authored
  2c9cde9

Commits on Nov 7, 2023

• Updated install doc to include MotherDuck support via DuckDB (#1963)

  janet-can

  authored
  59191bf

Commits on Nov 9, 2023

• remove % from pattern (#1956)

  Show description for c7182b1
  

  chuwangBA

  and

  m1n0

  authored
  c7182b1

Commits on Nov 14, 2023

• Sqlserver: support quoting tables with brackets, "quote_tables" mode (#1959)

  Show description for 7505aa3
  

  m1n0

  and

  pre-commit-ci[bot]

  authored
  7505aa3

• Bump to 3.0.54

  m1n0

  committed
  644546d

Commits on Nov 15, 2023

• Contracts

  Show description for 5f268b8
  

  3 peopleauthored
  5f268b8

• Fix check source payload (#1966)

  m1n0

  authored
  6ffddd9

Commits on Nov 16, 2023

• Bump to 3.1.0

  m1n0

  committed
  2a142e7

• Update python api docs (#1967)

  m1n0

  authored
  3f8fcc7

Commits on Nov 20, 2023

• Make custom identity fixed as v4 (#1968)

  m1n0

  authored
  88640a9

Commits on Dec 1, 2023

• Freshness: support in-check filters (#1970)

  m1n0

  authored
  09c00a2

Commits on Dec 2, 2023

• Bump to 3.1.1

  m1n0

  committed
  ae8d325

Commits on Dec 15, 2023

• Adding support for authentication via a chained list of delegate accounts. (#1973)

  nathadfield

  authored
  8249949

• fix anomaly detection frequency aggregation bug (#1975)

  Show description for 17c67cf
  

  baturayo

  and

  m1n0

  authored
  17c67cf

• upgrade pydantic from v1 to v2 (#1974)

  Show description for 46206eb
  

  3 peopleauthored
  46206eb

• [pre-commit.ci] pre-commit autoupdate (#1938)

  Show description for cb950c9
  pre-commit-ci[bot]

  authored
  cb950c9

• Bump to 3.1.2

  m1n0

  committed
  b7103e1

Commits on Dec 27, 2023

• feat: implement warn_only for anomaly score (#156) (#1980)

  Show description for e80f118
  

  baturayo

  and

  pre-commit-ci[bot]

  authored
  e80f118

Commits on Jan 3, 2024

• Bump to 3.1.3

  m1n0

  committed
  3c05346

Commits on Jan 4, 2024

• Dbt: improve parsing logs (#1981)

  m1n0

  authored
  1a44ce0

Commits on Jan 5, 2024

• Sampler: fix link href (#1983)

  m1n0

  authored
  2bde90c

• Document group by example for Soda Core with failed rows check (#1984)

  Show description for c3c9521
  janet-can

  authored
  c3c9521

Commits on Jan 16, 2024

• Schema check: support custom identity (#1988)

  m1n0

  authored
  45a5a74

Commits on Jan 23, 2024

• Add semver release with major, minor, latest (#1993)

  dirkgroenen

  authored
  34d65af

• bug: handle null values for continuous dist (#165) (#1994)

  Show description for 036204b
  

  baturayo

  and

  pre-commit-ci[bot]

  authored
  036204b

• [pre-commit.ci] pre-commit autoupdate (#1977)

  Show description for 55b85f5
  

  pre-commit-ci[bot]

  and

  m1n0

  authored
  55b85f5

Commits on Jan 24, 2024

• feat: implement new anomaly detection in soda core (#1995)

  Show description for ceab226
  

  baturayo

  and

  pre-commit-ci[bot]

  authored
  ceab226

• feat: support built-in prophet public holidays (#1997)

  Show description for 9445d1e
  baturayo

  authored
  9445d1e

• Bump to 3.1.4

  m1n0

  committed
  64bc338

• Hive data source improvements (#1982)

  Show description for b6f4329
  

  robertomorandeira

  and

  m1n0

  authored
  b6f4329

Commits on Jan 25, 2024

• feat: implement migrate from anomaly score check config (#168) (#1998)

  Show description for 79b513a
  baturayo

  authored
  79b513a

• Bump Prophet (#2000)

  m1n0

  authored
  311f1f2

• Tests: use approx comparison for floats (#1999)

  m1n0

  authored
  89da879

• hive: add configuration parameters (#36)

  

  vijaykiran

  authored and

  m1n0

  committed
  8e0ae62

Commits on Jan 26, 2024

• Bump to 3.1.5

  m1n0

  committed
  2d00558

Commits on Jan 29, 2024

• feat: implement severity level paramaters (#2001)

  Show description for 594d026
  baturayo

  authored
  594d026

• Always use datasource specifis COUNT expression (#2003)

  m1n0

  authored
  339309f

Commits on Jan 31, 2024

• fix: anomaly detection feedbacks (#2005)

  Show description for 51a30fb
  

  baturayo

  and

  pre-commit-ci[bot]

  authored
  51a30fb

Commits on Feb 2, 2024

• [pre-commit.ci] pre-commit autoupdate (#2002)

  Show description for 70b8753
  pre-commit-ci[bot]

  authored
  70b8753

Commits on Feb 6, 2024

• feat: anomaly detection simulator (#163) (#2010)

  Show description for 1d2e8ac
  baturayo

  authored
  1d2e8ac

Commits on Feb 7, 2024

• feat: added dremio token support (#2009)

  Show description for e172b7d
  

  JorisTruong

  and

  m1n0

  authored
  e172b7d

Commits on Feb 8, 2024

• Bump to 3.2.0

  m1n0

  committed
  fc8e191

Commits on Feb 9, 2024

• feat: correctly identified anomalies are excluded from training data (#2013)

  Show description for 68d44b3
  

  baturayo

  and

  pre-commit-ci[bot]

  authored
  68d44b3

• fix: show more clearly the detected frequency using warning message first (#2014)

  Show description for 1a211f5
  

  baturayo

  and

  pre-commit-ci[bot]

  authored
  1a211f5

Commits on Feb 12, 2024

• Fix simulator import and streamlit path (#2017)

  Show description for 16ea0b9
  

  m1n0

  and

  pre-commit-ci[bot]

  authored
  16ea0b9

Commits on Feb 13, 2024

• [pre-commit.ci] pre-commit autoupdate (#2016)

  Show description for a02f463
  pre-commit-ci[bot]

  authored
  a02f463

• Update oracle_data_source.py (#2012)

  Show description for 2c3ce9d
  

  3 peopleauthored
  2c3ce9d

• Oracle: cast config to str/int to prevent oracledb errors (#2018)

  m1n0

  authored
  eb2abf9

• Bump to 3.2.1

  m1n0

  committed
  dd63d9e

Commits on Feb 14, 2024

• Fix assets folder (#2020)

  m1n0

  authored
  ea5831e

Commits on Feb 21, 2024

• fix timezone issue and log messages (#188) (#2023)

  baturayo

  authored
  f47801c

Commits on Feb 28, 2024

• feat: in anomaly detection simulator use soda core historic check results endpoint instead of test results (#2025)

  Show description for fe70d82
  baturayo

  authored
  fe70d82

Commits on Feb 29, 2024

• Update dask-sql (#2026)

  Show description for 7d2ed7b
  m1n0

  authored
  7d2ed7b

• Add dask-sql version comment

  m1n0

  committed
  f07eba9

• Bump to 3.2.2

  m1n0

  committed
  97c3545

• feat: implement daily and monthly seasonality to external regressor … (#2027)

  Show description for 6245a4c
  

  baturayo

  and

  pre-commit-ci[bot]

  authored
  6245a4c

Commits on Mar 6, 2024

• Dremio: fix token support (#2028)

  m1n0

  authored
  b62550e

• Bump to 3.2.3

  m1n0

  committed
  8179c50

Commits on Mar 11, 2024

• [pre-commit.ci] pre-commit autoupdate (#2022)

  Show description for 8e41a2c
  

  pre-commit-ci[bot]

  and

  m1n0

  authored
  8e41a2c

Commits on Mar 12, 2024

• bugfix: support attributes on multiple checks (#2032)

  Show description for 91dd60f
  milanaleksic

  authored
  91dd60f

Commits on Mar 14, 2024

• Use dbt's new access_url pattern to access cloud API (#2035)

  Show description for e3787d1
  bastienboutonnet

  authored
  e3787d1

Commits on Mar 16, 2024

• Bump to 3.2.4

  m1n0

  committed
  c25a872

• Contracts 2nd iteration (#2006)

  Show description for 98c52ce
  

  3 peopleauthored
  98c52ce

• Bump to 3.3.0

  m1n0

  committed
  bd04e84

Commits on Mar 19, 2024

• feat: improved wording and tooltip formatting in simulator (#2038)

  bastienboutonnet

  authored
  a1a2008

Commits on Mar 22, 2024

• Failed rows: fix warn/fail thresholds (#2042)

  m1n0

  authored
  c20eb59

• Bump opentelemetry to 1.22 (#2043)

  m1n0

  authored
  de1d4b4

Commits on Mar 23, 2024

• Bump dev requirements (#2045)

  m1n0

  authored
  d4b8183

Commits on Mar 24, 2024

• Bump to 3.3.1

  m1n0

  committed
  ae33e9f

Commits on Apr 9, 2024

• Rename argument in set_scan_results_file method (#2047)

  Show description for aee8045
  ozgenbaris1

  authored
  aee8045

• Dremio: support disableCertificateVerification option (#2049)

  m1n0

  authored
  2e40e45

Commits on Apr 16, 2024

• [pre-commit.ci] pre-commit autoupdate (#2037)

  Show description for 9e95906
  pre-commit-ci[bot]

  authored
  9e95906

Commits on Apr 23, 2024

• Denodo: fix connection timeout attribute (#2065)

  m1n0

  authored
  1d21a34

• Update db2_data_source.py (#2063)

  Show description for 34ace6a
  

  3 peopleauthored
  34ace6a

Commits on Apr 24, 2024

• Bump to 3.3.2

  m1n0

  committed
  c046af0

Commits on Apr 30, 2024

• Update autoflake precommit (#2070)

  m1n0

  authored
  76159ca

• Contracts v3 (#2067)

  Show description for 062b1e2
  tombaeyens

  authored
  062b1e2

• Bump to 3.3.3

  tombaeyens

  committed
  5e51e69

Commits on May 3, 2024

• Fix automated monitoring, prevent duplicate queries (#2075)

  m1n0

  authored
  31b1ab3

Commits on May 7, 2024

• Hive: support scheme (#2077)

  m1n0

  authored
  cc02c01

• Bump dev requirements (#2078)

  m1n0

  authored
  63c73f8

• Bump deps (#2079)

  Show description for 7866d27
  m1n0

  authored
  7866d27

• Bump to 3.3.4

  m1n0

  committed
  8a1ce04

Commits on May 16, 2024

• Failed rows: fix warn/fail thresholds for fail condition (#2084)

  m1n0

  authored
  1819347

Commits on May 17, 2024

• upgrade to latest version of ibm-db python client (#2076)

  Antoninj

  authored
  09262b0

Commits on May 23, 2024

• User defined metric fail query (#2089)

  Show description for 5d1163c
  

  m1n0

  and

  pre-commit-ci[bot]

  authored
  5d1163c

• Bump to 3.3.5

  m1n0

  committed
  b014718

Commits on May 27, 2024

• CLOUD-7708 - Add Snowflake CI account to pipeline for soda-core (#2088)

  dakue-soda

  authored
  4e09b27

Commits on May 29, 2024

• [CLOUD-7400] Improve memory usage (#2081)

  Show description for 5776b5e
  

  dirkgroenen

  and

  pre-commit-ci[bot]

  authored
  5776b5e

Commits on May 30, 2024

• lower pre-commit version to support py38

  dirkgroenen

  committed
  c3dc141

Commits on Jun 5, 2024

• Duplicate check: fail gracefully in case of error in query (#2093)

  m1n0

  authored
  7e631d5

• Bump requests and tox/docker (#2094)

  Show description for 552a716
  m1n0

  authored
  552a716

Commits on Jun 7, 2024

• Duplicate check: support sample exclude columns fully (#2096)

  m1n0

  authored
  af649b9

Commits on Jun 17, 2024

• [pre-commit.ci] pre-commit autoupdate (#2069)

  Show description for 4a87865
  pre-commit-ci[bot]

  authored
  4a87865

Commits on Jun 18, 2024

• Spark: profiling support more text types (#2099)

  m1n0

  authored
  41e2d74

• Spark: profiling support more numeric types (#2100)

  m1n0

  authored
  16fa2c7

Commits on Jun 20, 2024

• Oracle: fix profiling/discovery queries, add numeric profiling (#2101)

  m1n0

  authored
  bcfb8c2

• Bump to 3.3.6

  m1n0

  committed
  46cd46d

Commits on Jun 25, 2024

• Updated readme for a little more incentive to migrate to soda-library (#2104)

  janet-can

  authored
  d70f765

Commits on Jun 26, 2024

• Oracle: fix formats, freshness, other minor fixes (#2106)

  m1n0

  authored
  fca862a

Commits on Jun 27, 2024

• Fix CI (#2112)

  m1n0

  authored
  8dff97b

• Http no failed rows (#2115)

  jzalucki

  authored
  375adea

• Wrong sample query missing count (#2114)

  jzalucki

  authored
  799a94b

• Between threshold error with variables (#2113)

  jzalucki

  authored
  d404bb5

Commits on Jun 28, 2024

• Bump to 3.3.7

  m1n0

  committed
  87cc985

• Duplicate check: remove unused aggregated query (#2118)

  m1n0

  authored
  7262ded

• Bump to 3.3.8

  m1n0

  committed
  ea74f4d

• Contracts4 (#2116)

  Show description for d377e91
  tombaeyens

  authored
  d377e91

• Added atlan package to tbump.toml

  tombaeyens

  committed
  abd3dfd

• Bump to 3.3.9

  tombaeyens

  committed
  9236f35

Commits on Jun 29, 2024

• Add scan_time to HttpSampler payload (#2121)

  m1n0

  authored
  43b6d08

Commits on Jul 5, 2024

• Fixing the default_data_source_properties for Atlan integration (#2127)

  tombaeyens

  authored
  dd8fdb1

Commits on Jul 6, 2024

• Bump to 3.3.10

  tombaeyens

  committed
  d529c2d

Commits on Jul 8, 2024

• Date format regex improvements (#2128)

  Show description for d877fbd
  

  3 peopleauthored
  d877fbd

Commits on Jul 9, 2024

• Duckdb: fix schema check for db in file (#2130)

  m1n0

  authored
  c510e0b

Commits on Jul 11, 2024

• Add ability to specify custom hostname for Snowflake connection (#2109)

  Show description for 3ace4c9
  whummer

  authored
  3ace4c9

Commits on Jul 16, 2024

• Better user provided queries sanitize. (#2131)

  Show description for 69007f6
  

  jzalucki

  and

  pre-commit-ci[bot]

  authored
  69007f6

• Add Scan Context to read/write data from/to a scan (#2134)

  m1n0

  authored
  26763eb

• Add sslmode support to pg and denodo (#2066)

  m1n0

  authored
  2293890

Commits on Jul 17, 2024

• Add support for custom sqlserver multi_subnet_failover parameter. (#2132)

  Show description for f13d268
  

  jzalucki

  and

  pre-commit-ci[bot]

  authored
  f13d268

• Ensure check identity is part of query name for failed rows queries. (#2117)

  Show description for 34a05ff
  

  jzalucki

  and

  pre-commit-ci[bot]

  authored
  34a05ff

• Bump to 3.3.11

  m1n0

  committed
  5d3577b

Commits on Jul 18, 2024

• Scan context: support list keys in getter (#2135)

  m1n0

  authored
  4fc27bb

• Bump to 3.3.12

  m1n0

  committed
  2921a0d

Commits on Jul 23, 2024

• Always reset logger when new Scan instance is created. (#2136)

  jzalucki

  authored
  90488ac

Commits on Jul 26, 2024

• chore: fix main pipeline, update healthcheck command after sqlserver docker image update. (#2138)

  jzalucki

  authored
  0d08f8c

• Bump to 3.3.13

  jzalucki

  committed
  90e7732

Commits on Jul 29, 2024

• Cross row count check should support custom identity. (#2139)

  jzalucki

  authored
  d97b704

Commits on Aug 1, 2024

• Handle sql exception nicely for failed rows and user-defined check. (#2140)

  Show description for 9ac3303
  jzalucki

  authored
  9ac3303

• Spark: send discovery data despite errors. (#2142)

  jzalucki

  authored
  8741aac

• Spark: failed rows metric result should not be limited to max 100 total results. (#2143)

  Show description for 0563049
  

  jzalucki

  and

  pre-commit-ci[bot]

  authored
  0563049

Commits on Aug 14, 2024

• Freshness: support variables in thresholds (#2146)

  m1n0

  authored
  ad9db79

Commits on Aug 15, 2024

• Spark: replicate implicit 'include all' in profiling consistently with other datasources (#2147)

  m1n0

  authored
  124e475

• Bump to 3.3.14

  m1n0

  committed
  7aa2b3e

Commits on Aug 19, 2024

• Comparison check - fix other table filter (#2149)

  jzalucki

  authored
  2a8f08d

• [pre-commit.ci] pre-commit autoupdate (#2141)

  Show description for f6f7bf2
  pre-commit-ci[bot]

  authored
  f6f7bf2

Commits on Aug 20, 2024

• Contracts7 : Fixing the integration correlation issue (#2148)

  Show description for 5dff022
  tombaeyens

  authored
  5dff022

• Bump to 3.3.15

  tombaeyens

  committed
  06cfa11

• creating a tbump hack

  tombaeyens

  committed
  62ee1e3

• Resetting contracts to 3.3.14 so tbump can work

  tombaeyens

  committed
  ec42e43

• Revert "Resetting contracts to 3.3.14 so tbump can work"

  Show description for bfc4c68
  tombaeyens

  committed
  bfc4c68

• Bump to 3.3.16

  tombaeyens

  committed
  73f18da

Commits on Aug 21, 2024

• Fixed the Atlan integration glue db-schema switch (#2152)

  Show description for 88234fa
  tombaeyens

  authored
  88234fa

• Bump to 3.3.17

  tombaeyens

  committed
  892c326

• Fixing atlan source contract yaml and lacking schema error message (#2153)

  tombaeyens

  authored
  f99eeb6

• Bump to 3.3.18

  tombaeyens

  committed
  da66239

Commits on Sep 5, 2024

• Fixing contract test library dependencies for test table creation (#2157)

  tombaeyens

  authored
  9147255

• Bump to 3.3.19

  tombaeyens

  committed
  5cf12cb

Commits on Sep 9, 2024

• Fixing the lacking data source error message on contract build (#2158)

  Show description for 8adf017
  

  tombaeyens

  and

  pre-commit-ci[bot]

  authored
  8adf017

• Bump to 3.3.20

  tombaeyens

  committed
  8c42941

Commits on Sep 11, 2024

• Fixing Spark session API (#2159)

  Show description for 0937aa0
  tombaeyens

  authored
  0937aa0

• Bump to 3.3.21

  tombaeyens

  committed
  a6f85fe

• Removing the data source name lower case requirement (#2161)

  Show description for 39ff346
  

  tombaeyens

  and

  pre-commit-ci[bot]

  authored
  39ff346

• Bump to 3.3.22

  tombaeyens

  committed
  2c8c5bd

Commits on Sep 23, 2024

• Add page to docs folder for data contracts language reference (#2166)

  janet-can

  authored
  8586ed4

Commits on Oct 15, 2024

• Add hiring banner to README (#2179)

  Show description for 52dc476
  dirkgroenen

  authored
  52dc476

Commits on Oct 21, 2024

• Add support for Azure SQL, Synapse, and Microsoft Fabric and extend support for SQL Server (#2160)

  Show description for a08bbcc
  

  3 peopleauthored
  a08bbcc

• Bump to 3.4.0

  m1n0

  committed
  c70fb78

Commits on Oct 22, 2024

• Add documentation for MS fabric package install + config (#2180)

  janet-can

  authored
  a59292a

• [pre-commit.ci] pre-commit autoupdate (#2177)

  Show description for fb60b83
  

  pre-commit-ci[bot]

  and

  m1n0

  authored
  fb60b83

• Comparison row count check secondary datasource filter fix (#2165)

  Show description for b91b1a9
  

  3 peopleauthored
  b91b1a9

• Bump to 3.4.1

  m1n0

  committed
  bbe338b

Commits on Nov 4, 2024

• Foreach: resolve vars in queries (#2183)

  m1n0

  authored
  0ecbec4

Commits on Nov 14, 2024

• Chore: use jinja sandbox for templates (#2185)

  Show description for a8c7d34
  m1n0

  authored
  a8c7d34

Commits on Nov 28, 2024

• Bump to 3.4.2

  m1n0

  committed
  b605610

• [pre-commit.ci] pre-commit autoupdate (#2182)

  Show description for 067c535
  

  pre-commit-ci[bot]

  and

  m1n0

  authored
  067c535

• Add include null to valid_count and invalid_count and percentage version. (#2186)

  Show description for d030911
  

  3 peopleauthored
  d030911

• Yaml: read and parse files thread-safe (#2188)

  m1n0

  authored
  9d4b349

Commits on Dec 2, 2024

• Bump to 3.4.3

  m1n0

  committed
  5021b74