* add -y for apt-get install to prevent image build failure

* sign

* sign

* sign

* fix tensorflow_mnist_train_distributed tutorial

* Update DWS-examples README to use latest Kueue version, delete Kueue manifest file

* Update tutorials-and-examples/workflow-orchestration/dws-examples/README.md

Co-authored-by: Aldo Culquicondor <[email protected]>

* Add link to Kueue's installation documentation

---------

Co-authored-by: Aldo Culquicondor <[email protected]>

…702)

* Add admission label selectors and e2e test script

* Edit log msgs

* Adding CSV output pushed by the Locust master

* Piping in output bucket

* removing gcs bucket

* Move webhook folder to ray-on-gke/tpu

* Change webhook path

* first commit

* remove terraform.tfvar

* refactoring

* remove hardcoding

* remove bash_equivalent

* first commit

* Update README.md

* Updated terraform providers

* Standardized GitOps scripts and added Kueue

* Added initial test harness

* Added h100 DWS node pool

* Add notebook packaging guide to docs (#690)

add notebook packaging guide

* Added enhancements to the dataprocessing use cases

* Updated Kueue to use the 0.7.0 manifests

* Increased the cluster resource limits

* Added products and features outline

* Added Secret Manager add-on to the cluster

* Changed configsync git respository name to allow for easier use of multiple environments

* Added a GitLab project module

* Standardized git variables to support GitHub or GitLab

* Added a100 40GB node pools

* Moved cpu node pool from n2 to n4 machines

* Add environment_name to the Ray dashboard endpoint

* Removed fleet level configmanagement and Google service accounts for each namespace to allow for multiple environments in a single project

* Added Config Controller Terraform module

* Added NVIDIA DCGM

* Added allow KubeRay Operator to the namespace network policy

---------

Co-authored-by: Kent Hua <[email protected]>
Co-authored-by: Jun Sheng <[email protected]>
Co-authored-by: Ishmeet Mehta <[email protected]>
Co-authored-by: Kavitha Rajendran <[email protected]>
Co-authored-by: kenthua <[email protected]>

* first commit

* terraform fmt

* Update README.md

* prometheus adapter module in main

* remove apply.sh

* typo

* terraform fmt

* large cleanup and validation

* moved fields and made module variables consistent with example variables

* parameterized accelerator selectors

* parameterize metrics scrape interval

* fmt

* fmt

* load parameters parameterization and multiple hpa resources

* fmt

* parameterized model name

* update readme and validators

* changes to jetstream module deployment readme

* terraform fmt

* accelerator_memory_used_percentage -> memory_used_percentage

* changes to READMEs

* tweaks

* metrics port optional

* sample tfvars no longer includes autoscaling config

* example autoscaling config

* Update README.md

* Update README.md

* Update README.md

* strengthen hpa config validation

* More updates to readmes

* tweak to readme

* typo

* missing kubectl apply

* typos

* Enable Ray Autoscaler for the Rag example application

* Update the ray application template

* Update finetune.yaml

…#712)

* Add HuggingFace support for automated inference checkpoint conversion

* Add HuggingFace support for inference checkpoint conversion

* fix llama checkpoint names

* update containers to v0.2.3 / v0.2.2

* update containers to v0.2.3 / v0.2.2