Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fails when importing large dataset (~100gb) #3

Open
rushilagr opened this issue May 31, 2017 · 0 comments
Open

Fails when importing large dataset (~100gb) #3

rushilagr opened this issue May 31, 2017 · 0 comments

Comments

@rushilagr
Copy link
Contributor

rushilagr commented May 31, 2017

While trying to import the current DBpedia dataset (144gb uncompressed), after a certain point, the program stops making any progress.

For the first few hours of the run, the importer runs superb. But after that, the graph db size always stagnates at 43GB.
The logger continues printing , but there is no real progress happening.

I have tried using high performance machines (100gb ram) but still no success.

Would really appreciate any help.
Thanks for the time.

@rushilagr rushilagr changed the title Execution failing when importing large dataset (~100gb) Fails when importing large dataset (~100gb) Jun 11, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant