Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for dropping invalid rows for pyspark backend #1639

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Merge branch 'main' into feature/pyspark-full-table-validation

86a34a4
Select commit
Loading
Failed to load commit list.
Open

Add support for dropping invalid rows for pyspark backend #1639

Merge branch 'main' into feature/pyspark-full-table-validation
86a34a4
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed Sep 1, 2024 in 1s

5.63% of diff hit (target 94.28%)

View this Pull Request on Codecov

5.63% of diff hit (target 94.28%)

Annotations

Check warning on line 4 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L3-L4 

Added lines #L3 - L4 were not covered by tests

Check warning on line 6 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L6 

Added line #L6 was not covered by tests

Check warning on line 8 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L8 

Added line #L8 was not covered by tests

Check warning on line 13 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L13 

Added line #L13 was not covered by tests

Check warning on line 16 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L16 

Added line #L16 was not covered by tests

Check warning on line 47 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L47 

Added line #L47 was not covered by tests

Check warning on line 60 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L58-L60 

Added lines #L58 - L60 were not covered by tests

Check warning on line 74 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L74 

Added line #L74 was not covered by tests

Check warning on line 87 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L85-L87 

Added lines #L85 - L87 were not covered by tests

Check warning on line 98 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L98 

Added line #L98 was not covered by tests

Check warning on line 112 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L110-L112 

Added lines #L110 - L112 were not covered by tests

Check warning on line 137 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L135-L137 

Added lines #L135 - L137 were not covered by tests

Check warning on line 149 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L149 

Added line #L149 was not covered by tests

Check warning on line 166 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L164-L166 

Added lines #L164 - L166 were not covered by tests

Check warning on line 195 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L193-L195 

Added lines #L193 - L195 were not covered by tests

Check warning on line 247 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L243-L247 

Added lines #L243 - L247 were not covered by tests

Check warning on line 259 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L259 

Added line #L259 was not covered by tests

Check warning on line 282 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L278-L282 

Added lines #L278 - L282 were not covered by tests

Check warning on line 316 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L312-L316 

Added lines #L312 - L316 were not covered by tests

Check warning on line 324 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L324 

Added line #L324 was not covered by tests

Check warning on line 339 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L336-L339 

Added lines #L336 - L339 were not covered by tests

Check warning on line 352 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L352 

Added line #L352 was not covered by tests

Check warning on line 367 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L365-L367 

Added lines #L365 - L367 were not covered by tests

Check warning on line 375 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L375 

Added line #L375 was not covered by tests

Check warning on line 390 in pandera/backends/pyspark/builtin_checks.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

pandera/backends/pyspark/builtin_checks.py#L388-L390 

Added lines #L388 - L390 were not covered by tests
View more details on Codecov