Troubleshoot dask and pandas (#847)

sodadata · Aug 8, 2024 · 855ff61 · 855ff61
1 parent d87c31f
commit 855ff61
Show file tree

Hide file tree

Showing 3 changed files with 19 additions and 0 deletions.
diff --git a/soda-cl/sample-datasets.md b/soda-cl/sample-datasets.md
@@ -96,6 +96,8 @@ Note that you cannot use an `exclude_columns` configuration to disable sample ro
 
 ## Specify columns for failed row sampling
 
+{% include banner-upgrade.md %}
+
 Beyond collecting samples of data from datasets, you can also use a `samples columns` configuration to an individual check to specify the columns for which Soda must implicitly collect failed row sample values. Soda only collects the check's failed row samples for the columns you specify in the list, as in the `duplicate_count` example below. 
 
 Soda implicitly collects failed row samples for the following checks:

diff --git a/soda/connect-dask.md b/soda/connect-dask.md
@@ -88,6 +88,8 @@ scan.set_verbose(True)
 scan.execute()
 ```
 
+<br />
+
 ### Load JSON file into Dataframe
 
 {% include code-header.html %}
@@ -103,6 +105,13 @@ df = pd.read_json('your_file.json')
 
 ...
 ```
+<br />
+
+## Troubleshoot
+
+**Problem:** You encounter errors when trying to install `soda-dask-pandas` in an environment that uses Python 3.11. This may manifest as an issue with dependencies or as an error that reads, `Pre-scan validation failed, see logs for details.`
+
+**Workaround:** Uninstall the `soda-dask-pandas` package, then downgrade the version of Python your environment uses to Python 3.9. Install the `soda-dask-pandas` package again. 
 
 <br />
 <br />

diff --git a/soda/connect-troubleshoot.md b/soda/connect-troubleshoot.md
@@ -41,6 +41,14 @@ Last modified on {% last_modified_at %}
 
 <br />
 
+## Scan error with Soda Dask and Pandas
+
+**Problem:** You encounter errors when trying to install `soda-dask-pandas` in an environment that uses Python 3.11. This may manifest as an issue with dependencies or as an error that reads, `Pre-scan validation failed, see logs for details.`
+
+**Workaround:** Uninstall the `soda-dask-pandas` package, then downgrade the version of Python your environment uses to Python 3.9. Install the `soda-dask-pandas` package again. 
+
+<br />
+
 ## Go further
 
 * Access [Troubleshoot SodaCL]({% link soda-cl/troubleshoot.md %}) for help resolving issues running scans with SodaCL.