Skip to content

Commit

Permalink
do not land: try out new gpu worker images
Browse files Browse the repository at this point in the history
  • Loading branch information
bhearsum committed Dec 21, 2023
1 parent d7f725e commit 36a246c
Show file tree
Hide file tree
Showing 3 changed files with 7 additions and 7 deletions.
10 changes: 5 additions & 5 deletions taskcluster/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,28 +34,28 @@ workers:
provisioner: '{trust-domain}-{level}'
implementation: generic-worker
os: linux
worker-type: 'b-linux-v100-gpu'
worker-type: 'b-linux-v100-gpu-relops782-test'
# Use for tasks that need lots of GPU power, but not lots of disk space
# eg: translation & scoring
b-largegpu:
provisioner: '{trust-domain}-{level}'
implementation: generic-worker
os: linux
worker-type: 'b-linux-v100-gpu-4'
worker-type: 'b-linux-v100-gpu-relops782-test'
# Use for tasks that needs lots of GPU power and increased disk space
# eg: bicleaner
b-largegpu-largedisk:
provisioner: '{trust-domain}-{level}'
implementation: generic-worker
os: linux
worker-type: 'b-linux-v100-gpu-4-300gb'
worker-type: 'b-linux-v100-gpu-relops782-test'
# Use for tasks that need lots of GPU power and immensive amounts of disk space
# eg: training
b-largegpu-xlargedisk:
provisioner: '{trust-domain}-{level}'
implementation: generic-worker
os: linux
worker-type: 'b-linux-v100-gpu-4-1tb'
worker-type: 'b-linux-v100-gpu-relops782-test'
images:
provisioner: '{trust-domain}-{level}'
implementation: docker-worker
Expand All @@ -65,7 +65,7 @@ workers:
# Keys are worker type, and align with the `worker-type` entries in the
# `worker.aliases` above.
worker-configuration:
b-linux-v100-gpu:
b-linux-v100-gpu-relops782-test:
env:
GPUS: "0"
WORKSPACE: "12000"
Expand Down
2 changes: 1 addition & 1 deletion taskcluster/kinds/all-pr/kind.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ kind-dependencies:

tasks:
all:
description: Dummy task that ensures all parts of training pipeline will run
description: Dummy task that ensures all parts of training pipeline will run.
attributes:
stage: all-pr
src_locale: "{src_locale}"
Expand Down
2 changes: 1 addition & 1 deletion taskcluster/translations_taskgraph/target_tasks.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ def filter(task):
if task.attributes.get("trg_locale") != trg:
return False

# Datasets are only applicable to dataset-specific tasks. If these
# Datasets are only applicable to dataset-specific tasks. If these
# attribute isn't present on the task it can be assumed to be included
# if the above attributes matched, as it will be a task that is either
# agnostic of datasets, or folds in datasets from earlier tasks.
Expand Down

0 comments on commit 36a246c

Please sign in to comment.