-
Notifications
You must be signed in to change notification settings - Fork 30
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add RowBinary format for SELECT operations #216
Comments
@slvrtrn Thanks for working on this! I'm watching this topic closely since it'll be useful for the work I do. My workload also contains Arrays and Maps (to better cope with semi-hierarchical data) and even some Nested types. Guess I'll wait until Arrays and Maps are supported before jumping in. I also consider moving away from Nested, since it tends to make things more complicated and support for de-/serializing is often lacking / coming last. Again, thanks for working on this. I plan at least to support in testing once progress is enough for my usecases. BTW I'm using both INSERTs and SELECTs. |
@cjk, thanks for your feedback. I haven't looked into Nested yet, as the core part was to get the numeric types right first, but I believe it will be one of the trickier data types to implement there. If you could provide a sample dataset for benchmarks or just table DDLs (I will just generate the random data there in the right shape), that would be great. |
Work in progress: #257
If you have any feedback on the following, please don't hesitate to comment.
Streaming will be supported out of the box by design.
Target supported ClickHouse data types with SELECT operations for the initial release; certain types are already completed in the branch:
number
BigInt
number
string
JS Date
, astring
, or UNIX seconds as anumber
/BigInt
by default (needs the decision to be consistent with DateTime family types), with a custom mapper support.string
orBigInt
UNIX seconds. DateTime64 should be either astring
or UNIX nanoseconds as aBigInt
.string
string
string
string
by default, support custom mapper[number, number]
for Point as the base for the remaining Geo types.The types that may be included as well, depending on the format complexity:
Related issues:
The text was updated successfully, but these errors were encountered: