Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wrap outrun and use it as decorator #13

Open
hugocatlas opened this issue Mar 29, 2021 · 2 comments
Open

Wrap outrun and use it as decorator #13

hugocatlas opened this issue Mar 29, 2021 · 2 comments

Comments

@hugocatlas
Copy link

Dear outrun dev team,

Just bumped into this awesome tool and I'd like to send kudos to the dev team for implementing it.
I was wondering: would it be imaginable to allow outrun to be used as a Python decorator?
Imagine I'm working in a Jupyter Notebook in one cloud machine that is very small but ok for notebooking. Now imagine that one of my analysis Python (or wrapped in Python code) functions requires a significant amount of computing power that is not available on the machine I'm working on.
In my work environment, it's very simple for me to fire-up a more powerful machine, but this requires me to migrate my notebook to this new machine. However, if I could just decorate my computing function in my notebook indicating that it has to run in another machine, this would make my life 1000x easier.

It would be extremely helpful if outrun could support this use case. How does it sound?

Cheers,

Hugo

@setop
Copy link

setop commented Jun 3, 2021

You may have a look at https://dask.org/ which is designed for distributed dataframe.

@hugocatlas
Copy link
Author

You may have a look at https://dask.org/ which is designed for distributed dataframe.

I know Dask but the use case I described goes way beyond the scope of dataframes...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants