Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve DType Exception Handling for CSV Read/Write #4800

Open
stanbrub opened this issue Nov 9, 2023 · 0 comments
Open

Improve DType Exception Handling for CSV Read/Write #4800

stanbrub opened this issue Nov 9, 2023 · 0 comments

Comments

@stanbrub
Copy link
Contributor

stanbrub commented Nov 9, 2023

DTypes are documented for use with Deephaven CSV. However, all data types are not supported. The read_csv operation may throw a cryptic exception while the write_csv operation doesn't throw an exception but happily write out something to CSV that makes no sense.

It is not clear from either the exceptions or the documentation which column types are supported.

Examples:

  • read_csv while passing in dht.BigDecimal results in a KeyError
  • write_csv writes an array column without an exception but writes square brackets and identity hash, which is not useful.
  • write_csv write Vector summary [a,b,c...], which is not useful either
  • write_csv writes the value a value that read_csv won't read

Resources:

@stanbrub stanbrub added feature request New feature or request triage labels Nov 9, 2023
@stanbrub stanbrub changed the title Support Vectors In DType for CSV Read Improve DType Exception Handling for CSV Read/Write Nov 14, 2023
@stanbrub stanbrub added the csv label Nov 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants