README.md

Tutorials

Quickstart Tutorial

Find the quickstart tutorial on Google Cloud docs.

HTCondor Tutorial

Walk through deploying an HTCondor pool that supports jobs running inside Docker containers or the base HPC VM Image.

Click the button below to launch the HTCondor tutorial.

SC-23 Tutorial

Blueprint used in the Supercomputing 2023 tutorial “Unlocking the potential of HPC in the Google Cloud with Open-Source Tools”

Application Specific Tutorials

The following three tutorials deploy a cluster, install an hpc application (Growmacs, Openfoam, or WRF), and walk through submitting a real workload.

By default these tutorials build the applications from source, which takes several hours on deployment. If a complete Spack cache is provided using the spack_cache_mirror_url variable, application installation can be reduced to 6 minutes.

Gromacs

Openfoam

Weather Research and Forecasting (WRF) Model

Blueprint Diagram for Application Tutorials

All the application specific tutorials above use similar blueprints built of from a number of terraform modules. The diagram below shows how the various modules relate to each other.

graph TB
    A(Virtual Private Cloud)
    C(Spack Install Script)
    D(Startup Scripts)
    E(Compute Partition)
    F(Slurm Controller)
    G(Slurm Login Node)
    B(Monitoring Dashboard)
    C --> D
    A --> E
    A --> F
    E --> F
    D --> F
    A --> G
    F --> G

Loading

Qwiklabs Tutorial

The hpc-slurm-qwiklabs.yaml blueprint is meant for use in Qwiklabs tutorials and uses machine types that are compatible with Qwiklabs.