Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support multi process in download #18

Open
oreenlivnicode opened this issue Sep 19, 2023 · 1 comment
Open

Support multi process in download #18

oreenlivnicode opened this issue Sep 19, 2023 · 1 comment
Labels
blocked feature Medium Priority
Milestone
Nice to have feat...

Comments

@oreenlivnicode
Copy link
Contributor

Currently, passing Config object arrives empty to the index_workflow_file function.
This happens because processes use separate memory, we should pass the relevant config params to the function or use Manager.
@oreenlivnicode oreenlivnicode added bug Something isn't working Medium Priority labels Sep 19, 2023
@oreenlivnicode oreenlivnicode added this to the Must do features milestone Sep 19, 2023
@oreenlivnicode oreenlivnicode added feature and removed bug Something isn't working labels Sep 27, 2023
@elad-pticha
Copy link
Contributor

When we handle #78 we can move to this. Multi-processing will cause a rate-limit very quickly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
blocked feature Medium Priority
Projects
None yet
Milestone
Nice to have features
Development

No branches or pull requests
2 participants
@elad-pticha @oreenlivnicode