Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JupyterLab on multiple nodes? #11

Open
simonLeary42 opened this issue Jan 4, 2023 · 1 comment
Open

JupyterLab on multiple nodes? #11

simonLeary42 opened this issue Jan 4, 2023 · 1 comment

Comments

@simonLeary42
Copy link

This app will launch a Jupyter Notebook server on one or more nodes.

- bc_num_slots

Would JupyterLab work as expected if run on multiple nodes? When the user logs in to their server, which node does the link lead to?

It was my understanding that the only way for processes to work together across multiple nodes is if they use message passing or memory parallelization. Is that not true? Does JupyterLab come with these features?

Looking around, I found that Princeton says that JupyterLab should be run on just one node:
https://researchcomputing.princeton.edu/support/knowledge-base/jupyter

@johrstrom
Copy link

I think you're right that you'd need some fancy footwork in the script so that you only launch the notebook on one node.

We do something similar with Jupyter + Spark where we only start the Spark server on one node and we launch workers on the others.

That said - you have me questioning whether that works as expected and if we are indeed starting a notebook on both nodes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants