-
Notifications
You must be signed in to change notification settings - Fork 430
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Windows paths: spaces are parsed to %20 (reading delta table) #1391
Comments
same issue here |
Using 0.10.2, I'm having this same issue where Windows paths cannot be decoded due to their spaceyness. Writing only succeeds where paths which have no space characters. :( |
Using 0.16.4 I am having same issue. Running Python code from a path that contains spaces gives me 'object at location <FILL PATH WITH SPACES that have been replaced with %20 .... parquet file> not found .... Read Data from Delta tabledt.to_pandas() |
Quickstart on Homepage results in error in reading (writing part goes ok), same issue as my previous post. |
Is this still an issue with 0.22.3? |
It's working! |
Environment
Delta-rs version:
Python deltalake 0.9.0
Environment:
Bug
What happened:
Reading a delta table inside a folder which contains spaces thorws an error.
A new folder containing "%20" instead of spaces is created.
This folder/delta table was written using deltalake, and created in the expected location.
What you expected to happen:
The table should be created and read in the same folder.
How to reproduce it:
`import deltalake as dl
dl.write_deltalake(table_or_uri="./deltalake/data",data=DATAFRAME, mode="append")
data = dl.DeltaTable(table_uri="./deltalake/data")
print(data.to_pandas())`
More details:
File "(...)\Lib\site-packages\deltalake\table.py", line 442, in to_pandas
return self.to_pyarrow_table(
^^^^^^^^^^^^^^^^^^^^^^
File "(...)\Lib\site-packages\deltalake\table.py", line 426, in to_pyarrow_table
).to_table(columns=columns)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "pyarrow_dataset.pyx", line 546, in pyarrow._dataset.Dataset.to_table
File "pyarrow_dataset.pyx", line 3449, in pyarrow._dataset.Scanner.to_table
File "pyarrow\error.pxi", line 144, in pyarrow.lib.pyarrow_internal_check_status
File "pyarrow_fs.pyx", line 1551, in pyarrow._fs._cb_open_input_file
File "(...)\Lib\site-packages\deltalake\fs.py", line 22, in open_input_file
return pa.PythonFile(DeltaFileSystemHandler.open_input_file(self, path))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
deltalake.PyDeltaTableError: Object at location C:\Folders\Prefix%20-%20Suffix\deltalake\data\0-8162c431-b69c-4931-8618-75de0202cbc6-0.parquet not found: (...) (os error 2)
The text was updated successfully, but these errors were encountered: