ansible-role-jupyterhub-env

A role to setup a node with a jupyterhub that spawns jupyterlab with or without GPU utilization and a monitoring service.

Requirements

There are no requirements. This role will setup all the necessary dependencies.

Role Variables

defaults

Variable for the monitoring service:

• install_docker: bool (default: yes)
• install_docker_compose: bool (default: yes)
• docker_compose_version: string (default: "1.29.2")
• install_nvidia_driver: bool (default: yes)
• install_nvidia_driver_from_cuda: bool (default: yes)
• install_nvidia_container_toolkit: bool (default: yes)
• nvidia_driver_skip_reboot: bool (default: yes)
• gpu_partition_flavor: string, enable the A100 GPU partitioning, four values allowed (default: "None")
• run_jupyter: bool, if you want to run the jupyterhub compose (default: yes)
• jupyter_port: string (default: "8888")
• jupyter_proxy_token: string, token needed for the collaborative service, autogenerated if empty (default: "")
• jupyter_images: string, Comma separated image list (default: "dodasts/snj-base-lab:v1.0.0-snj")
• jupyter_use_gpu: bool, if to enable the jupyter notebook to use the GPU (default: no)
• jupyter_default_spawner: string, indicates to start with lab or notebook (possible values: ["LAB", "NOTEBOOK"])
• jupyter_post_start_cmd: string, the command to run after jupyter spawned (default: "")
• jupyter_host_mount_dir: path of base mount point in the host machine (default: "")
• jupyter_mount_dir: path of mount point in the jupyter env (default: "")
• jupyterlab_collaborative: bool, if to deploy the collaborative service (default: no)
• jupyterlab_collaborative_use_gpu: bool, if to enable the collaborative service to use the GPU (default: no)
• jupyterlab_collaborative_image: string, the collaborative Docker image (default: "dodasts/snj-base-jlabc:v1.0.0-snj")
• iam_url: URL of the IAM service
• iam_groups: string with the name of the IAM groups allowed (space separated)
• iam_admin_groups: string with the name of the IAM groups that will be admin (space separated)
• iam_subject : token subject of the user deploying the service
• server_ip: string with the ip of the current server
• monitoring: bool, if to deploy the monitoring service (default: yes)
• grafana: "yes" if you want to setup also grafana
• grafana_port: int, the grafana service port
• grafana_admin_user: string
• grafana_admin_password: string
• grafana_client_id: string (used for the IAM login)
• grafana_client_secret: string (used for the IAM login)
• grafana_image: string (default: "dodasts/monitoring-grafana:v1.0.8-monitoring")
• cvmfs_repos: string, list of the cvmfs repo to mount (default: "")

vars

The following string variables will be filled with the docker service information:

• jupyter_gpu: string (default: "WITH_GPU=false")
• cvmfs_service: string (default: "")
• compose_base_jhub_image: string (default: "dodasts/snj-base-jhub:v1.0.0-snj")
• compose_base_http_proxy_image: string (default: "jupyterhub/configurable-http-proxy")
• compose_base_collab_http_proxy_image: string (default: "dodasts/snj-base-jlabc-proxy:v1.0.0-snj")
• jupyterlab_collaborative_service: string (default: "")
• jupyterlab_collaborative_service_dependency: string (default: "")
• jupyterlab_collaborative_image_param: string (default: "image: dodasts/snj-base-jlabc:v1.0.0-snj")
• jupyterlab_collaborative_gpu_param: string (default: "")
• jupyter_with_cvmfs: bool (default: false)
• jupyter_collab_service: bool (default: false)
• gpu_partition_flavor: string, enable the A100 GPU partitioning, four values allowed (default: "None")
• use_gpu: bool, if the GPU can be used or not (default: no)

Dependencies

There are no other dependencies.

Example Playbook

Including an example of how to use your role (for instance, with variables passed in as parameters) is always nice for users too:

    - hosts: servers
      roles:
         - role: ansible-role-jupyterhub-env
           server_ip: "a.b.c.d"
           jupyterlab_collaborative: yes 
           monitoring: no 
           run_jupyter: no 
           iam_url: https://iam.example.service.it 
           iam_groups: groupA

📎 Current status

• Installation of nvidia cuda driver:
  • Ubuntu (tested on 18.04)
  • RedHat (CentOS)
• Installation of nvidia-docker2:
  • Ubuntu (tested on 18.04)
• Installation of docker-compose
• Installation of Jupyter-Hub from dodas-ts
  • Run the Jupyter-hub

🔗 Useful resources

• External roles:

  • gpu-support
  • monitoring

• Installation reference:

  • cuda driver
  • nvidia docker installation guide

License

Apache 2.0

Author Information

DODAS-TS