Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HELP] Wiki and demo code about read ultra large dataset #186

Open
xieguigang opened this issue Aug 10, 2023 · 0 comments
Open

[HELP] Wiki and demo code about read ultra large dataset #186

xieguigang opened this issue Aug 10, 2023 · 0 comments

Comments

@xieguigang
Copy link

xieguigang commented Aug 10, 2023

Hi,

Many thanks for this great data format library.

I'm working on read a ultra large hdf5 dataset via HDF.PInvoke recently. Due to the reason of .NET array can not be allocated in size greater than 2GB, so if the data inside the hdf5 file its size is greater than 2GB, then the program crashed.

The dataset which its size less than 2GB could be read via the demo code in wiki Cookbook : Datasets, and I guess i could read the dataset which its size greater than 2GB chunk by chunk via HDF.PInvoke, but after google search around it, i was not able to figure out how to implements such code correctly.

Here is the DEMO data in ultra large size that i currently working on: download the P_1900 | Human Prostate dataset from this repository.

@xieguigang xieguigang reopened this Aug 10, 2023
@xieguigang xieguigang changed the title [HELP] It is there is [HELP] Wiki and demo code about read ultra large dataset Aug 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant