Skip to content

Commit

Permalink
Updates
Browse files Browse the repository at this point in the history
  • Loading branch information
romilbhardwaj committed Dec 18, 2024
1 parent fb32813 commit bc4929c
Showing 1 changed file with 31 additions and 24 deletions.
55 changes: 31 additions & 24 deletions docs/source/reference/kubernetes/kubernetes-getting-started.rst
Original file line number Diff line number Diff line change
Expand Up @@ -119,6 +119,37 @@ Once your cluster administrator has :ref:`setup a Kubernetes cluster <kubernetes
$ kubectl config set-context --current --namespace=mynamespace
Listing available GPUs
----------------------

You can list the GPUs available on your cluster with :code:`sky show-gpus`.
It will show the total GPUs and free GPUs for each GPU type on the cluster, as well as the per node GPU availability.

.. code-block:: console
$ sky show-gpus
Kubernetes GPUs
GPU QTY_PER_NODE TOTAL_GPUS TOTAL_FREE_GPUS
L4 1, 2, 4 12 2
H100 1, 2, 4, 8 16 12
Kubernetes per node GPU availability
NODE_NAME GPU_NAME TOTAL_GPUS FREE_GPUS
gke-inference-pool-0 L4 4 2
gke-inference-pool-1 L4 4 0
gke-inference-pool-2 L4 2 0
gke-inference-pool-3 L4 2 0
gke-training-pool-0 H100 8 8
gke-training-pool-1 H100 8 4
Cloud GPUs
COMMON_GPU AVAILABLE_QUANTITIES
A10 1, 2, 4
A100 1, 2, 4, 8, 16
A100-80GB 1, 2, 4, 8
H100 1, 2, 4, 8, 12
...
Viewing cluster status
----------------------
Expand Down Expand Up @@ -170,30 +201,6 @@ You can also inspect the real-time GPU usage on the cluster with :code:`sky show
my-cluster-5 H100 8 8
Listing Available GPUs
----------------------

You can list the GPUs available on your cluster with :code:`sky show-gpus --cloud kubernetes`.
It will show the total GPUs and free GPUs for each GPU type on the cluster, as well as the per node GPU availability.

.. code-block:: console
$ sky show-gpus --cloud kubernetes
Kubernetes GPUs
GPU QTY_PER_NODE TOTAL_GPUS TOTAL_FREE_GPUS
L4 1, 2, 4 12 2
H100 1, 2, 4, 8 16 12
Kubernetes per node GPU availability
NODE_NAME GPU_NAME TOTAL_GPUS FREE_GPUS
gke-inference-pool-0 L4 4 2
gke-inference-pool-1 L4 4 0
gke-inference-pool-2 L4 2 0
gke-inference-pool-3 L4 2 0
gke-training-pool-0 H100 8 8
gke-training-pool-1 H100 8 4
.. _kubernetes-custom-images:

Using Custom Images
Expand Down

0 comments on commit bc4929c

Please sign in to comment.