Skip to content

Read data by column #36

Answered by AlexTimo
SreekanthMekala asked this question in Q&A
May 18, 2021 · 3 comments · 2 replies
Discussion options

You must be logged in to vote

I've a done a test with 100K rows and 50 columns, it took about 2 min and 20 seconds to parse the file and find unique values in two columns. Since xlstream is optimized for maintaining low memory footprint, you may be better served by a library that loads the whole file into memory first. For example, the same task (finding unique values in two columns) took about 50 seconds when using SheetJS (xlsx package).

Replies: 3 comments 2 replies

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
2 replies
@AlexTimo
Comment options

@SreekanthMekala
Comment options

Comment options

You must be logged in to vote
0 replies
Answer selected by AlexTimo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants
Converted from issue

This discussion was converted from issue #35 on May 19, 2021 13:37.