Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Columnar storage for index structure #15

Open
gfl94 opened this issue Jun 1, 2016 · 1 comment
Open

Columnar storage for index structure #15

gfl94 opened this issue Jun 1, 2016 · 1 comment
Assignees

Comments

@gfl94
Copy link
Member

gfl94 commented Jun 1, 2016

We can integrate IndexManger together with CacheManager, IndexManager use a bytebuffer for IndexInfo storage, and CacheManager use a column store for CacheData and CacheInfo, perhaps we can put them together?

@dongx-psu
Copy link
Member

No, this is not the case. I mean we can give users a choice to replace the Array[InternalRow] in IPartition to columnar format like the original Spark SQL cache mechanism.

@dongx-psu dongx-psu changed the title Merge IndexManager and CacheManager Columnar storage for index structure Jun 2, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants