Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add computing requirements #117

Open
MokhFn opened this issue Aug 29, 2023 · 0 comments
Open

Add computing requirements #117

MokhFn opened this issue Aug 29, 2023 · 0 comments

Comments

@MokhFn
Copy link
Contributor

MokhFn commented Aug 29, 2023

I am trying to launch the Index on 4 chains with data going back to 2018.
When doing so (on only one of the 4, in this case Cardano), the CLI crashes (killed) which was certainly caused by lack of resources.
It would be great to add performance benchmarks, or minimal computing requirements etc ...

If computing becomes such a huge component, maybe also use some computing engines (like Apache Spark) instead of pure python.
Spark is data centric, and can be very powerful when computing important volumes of data.

As a workaround, i had to add a 10Gb swapfile to handle the execution of only one chain.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant