Update references to Hugging Face DLC for TGI #816
Google Cloud Build / pr-review-trigger-ap-clusters (gke-ai-eco-dev)
failed
Sep 17, 2024 in 5m 57s
Summary
Build Information
Trigger | pr-review-trigger-ap-clusters |
Build | d14da3ce-778d-42e6-b6d0-0923c2072127 |
Start | 2024-09-17T10:01:25-07:00 |
Duration | 5m15.856s |
Status | FAILURE |
Steps
Step | Status | Duration |
---|---|---|
validate platform | SUCCESS | 54.021s |
validate ray | SUCCESS | 16.843s |
validate jupyterhub | SUCCESS | 16.839s |
validate rag | SUCCESS | 17.395s |
create gke cluster | FAILURE | 1m59.35s |
test ray cluster | FAILURE | 2.79s |
cleanup ray cluster | SUCCESS | 5.667s |
test jupyterhub | FAILURE | 18.341s |
cleanup jupyterhub | FAILURE | 14.058s |
test rag | FAILURE | 2.91s |
cleanup rag | SUCCESS | 6.335s |
cleanup gke cluster | SUCCESS | 1m27.473s |
check result | FAILURE | 611ms |
Details
starting build "d14da3ce-778d-42e6-b6d0-0923c2072127"
FETCHSOURCE
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint:
hint: git config --global init.defaultBranch <name>
hint:
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint:
hint: git branch -m <name>
Initialized empty Git repository in /workspace/.git/
From https://github.com/GoogleCloudPlatform/ai-on-gke
* branch c5a46693925c9638d288b05eb758bcf8fd22b599 -> FETCH_HEAD
HEAD is now at c5a4669 Revert `image` on benchmarks until verified
SETUPBUILD
BUILD
Starting Step #0 - "validate platform"
Step #0 - "validate platform": Pulling image: gcr.io/gke-ai-eco-dev/terraform
Step #0 - "validate platform": Using default tag: latest
Step #0 - "validate platform": latest: Pulling from gke-ai-eco-dev/terraform
Step #0 - "validate platform": ddf874abf16c: Pulling fs layer
Step #0 - "validate platform": ecfb911cf53f: Pulling fs layer
Step #0 - "validate platform": ce689bb70bd5: Pulling fs layer
Step #0 - "validate platform": 7d2b54998739: Pulling fs layer
Step #0 - "validate platform": b1c39b09da0f: Pulling fs layer
Step #0 - "validate platform": cc032834b94b: Pulling fs layer
Step #0 - "validate platform": 0279610fca41: Pulling fs layer
Step #0 - "validate platform": 6f125b563dda: Pulling fs layer
Step #0 - "validate platform": 7c8b6e22fcff: Pulling fs layer
Step #0 - "validate platform": faaaa1840355: Pulling fs layer
Step #0 - "validate platform": 60a28c2199b1: Pulling fs layer
Step #0 - "validate platform": 4c7171ac56db: Pulling fs layer
Step #0 - "validate platform": 372d85ec2f1f: Pulling fs layer
Step #0 - "validate platform": 633b411e5bd5: Pulling fs layer
Step #0 - "validate platform": 6f125b563dda: Waiting
Step #0 - "validate platform": b1c39b09da0f: Waiting
Step #0 - "validate platform": 7d2b54998739: Waiting
Step #0 - "validate platform": cc032834b94b: Waiting
Step #0 - "validate platform": 0279610fca41: Waiting
Step #0 - "validate platform": 372d85ec2f1f: Waiting
Step #0 - "validate platform": 4c7171ac56db: Waiting
Step #0 - "validate platform": 7c8b6e22fcff: Waiting
Step #0 - "validate platform": 60a28c2199b1: Waiting
Step #0 - "validate platform": 633b411e5bd5: Waiting
Step #0 - "validate platform": ecfb911cf53f: Verifying Checksum
Step #0 - "validate platform": ecfb911cf53f: Download complete
Step #0 - "validate platform": ce689bb70bd5: Verifying Checksum
Step #0 - "validate platform": ce689bb70bd5: Download complete
Step #0 - "validate platform": 7d2b54998739: Download complete
Step #0 - "validate platform": ddf874abf16c: Verifying Checksum
Step #0 - "validate platform": ddf874abf16c: Download complete
Step #0 - "validate platform": 0279610fca41: Verifying Checksum
Step #0 - "validate platform": 0279610fca41: Download complete
Step #0 - "validate platform": 6f125b563dda: Download complete
Step #0 - "validate platform": 7c8b6e22fcff: Verifying Checksum
Step #0 - "validate platform": 7c8b6e22fcff: Download complete
Step #0 - "validate platform": cc032834b94b: Verifying Checksum
Step #0 - "validate platform": cc032834b94b: Download complete
Step #0 - "validate platform": faaaa1840355: Verifying Checksum
Step #0 - "validate platform": faaaa1840355: Download complete
Step #0 - "validate platform": 60a28c2199b1: Verifying Checksum
Step #0 - "validate platform": 60a28c2199b1: Download complete
Step #0 - "validate platform": 4c7171ac56db: Verifying Checksum
Step #0 - "validate platform": 4c7171ac56db: Download complete
Step #0 - "validate platform": 372d85ec2f1f: Verifying Checksum
Step #0 - "validate platform": 372d85ec2f1f: Download complete
Step #0 - "validate platform": ddf874abf16c: Pull complete
Step #0 - "validate platform": ecfb911cf53f: Pull complete
Step #0 - "validate platform": ce689bb70bd5: Pull complete
Step #0 - "validate platform": 7d2b54998739: Pull complete
Step #0 - "validate platform": 633b411e5bd5: Verifying Checksum
Step #0 - "validate platform": 633b411e5bd5: Download complete
Step #0 - "validate platform": b1c39b09da0f: Verifying Checksum
Step #0 - "validate platform": b1c39b09da0f: Download complete
Step #0 - "validate platform": b1c39b09da0f: Pull complete
Step #0 - "validate platform": cc032834b94b: Pull complete
Step #0 - "validate platform": 0279610fca41: Pull complete
Step #0 - "validate platform": 6f125b563dda: Pull complete
Step #0 - "validate platform": 7c8b6e22fcff: Pull complete
Step #0 - "validate platform": faaaa1840355: Pull complete
Step #0 - "validate platform": 60a28c2199b1: Pull complete
Step #0 - "validate platform": 4c7171ac56db: Pull complete
Step #0 - "validate platform": 372d85ec2f1f: Pull complete
Step #0 - "validate platform": 633b411e5bd5: Pull complete
Step #0 - "validate platform": Digest: sha256:202db292b551d530ff51210759dd25971cb64b5afe675a5616e0c244d48a452b
Step #0 - "validate platform": Status: Downloaded newer image for gcr.io/gke-ai-eco-dev/terraform:latest
Step #0 - "validate platform": gcr.io/gke-ai-eco-dev/terraform:latest
Step #0 - "validate platform":
Step #0 - "validate platform": Initializing the backend...
Step #0 - "validate platform": Initializing modules...
Step #0 - "validate platform": Downloading registry.terraform.io/terraform-google-modules/cloud-nat/google 5.0.0 for cloud-nat...
Step #0 - "validate platform": - cloud-nat in .terraform/modules/cloud-nat
Step #0 - "validate platform": - custom-network in ../modules/gcp-network
Step #0 - "validate platform": - private-gke-autopilot-cluster in ../modules/gke-autopilot-private-cluster
Step #0 - "validate platform": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for private-gke-autopilot-cluster.gke...
Step #0 - "validate platform": - private-gke-autopilot-cluster.gke in .terraform/modules/private-gke-autopilot-cluster.gke/modules/beta-autopilot-private-cluster
Step #0 - "validate platform": - private-gke-standard-cluster in ../modules/gke-standard-private-cluster
Step #0 - "validate platform": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for private-gke-standard-cluster.gke...
Step #0 - "validate platform": - private-gke-standard-cluster.gke in .terraform/modules/private-gke-standard-cluster.gke/modules/private-cluster
Step #0 - "validate platform": - public-gke-autopilot-cluster in ../modules/gke-autopilot-public-cluster
Step #0 - "validate platform": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for public-gke-autopilot-cluster.gke...
Step #0 - "validate platform": - public-gke-autopilot-cluster.gke in .terraform/modules/public-gke-autopilot-cluster.gke/modules/beta-autopilot-public-cluster
Step #0 - "validate platform": - public-gke-standard-cluster in ../modules/gke-standard-public-cluster
Step #0 - "validate platform": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for public-gke-standard-cluster.gke...
Step #0 - "validate platform": - public-gke-standard-cluster.gke in .terraform/modules/public-gke-standard-cluster.gke
Step #0 - "validate platform":
Step #0 - "validate platform": Initializing provider plugins...
Step #0 - "validate platform": - Finding hashicorp/kubernetes versions matching "~> 2.10, 2.18.1"...
Step #0 - "validate platform": - Finding hashicorp/google versions matching ">= 4.51.0, >= 5.40.0, != 5.44.0, < 6.0.0, < 7.0.0"...
Step #0 - "validate platform": - Finding hashicorp/google-beta versions matching ">= 5.40.0, != 5.44.0, != 6.2.0, < 7.0.0"...
Step #0 - "validate platform": - Finding hashicorp/random versions matching ">= 2.1.0, ~> 3.0"...
Step #0 - "validate platform": - Finding hashicorp/helm versions matching "~> 2.8.0"...
Step #0 - "validate platform": - Installing hashicorp/kubernetes v2.18.1...
Step #0 - "validate platform": - Installed hashicorp/kubernetes v2.18.1 (signed by HashiCorp)
Step #0 - "validate platform": - Installing hashicorp/google v5.43.1...
Step #0 - "validate platform": - Installed hashicorp/google v5.43.1 (signed by HashiCorp)
Step #0 - "validate platform": - Installing hashicorp/google-beta v6.3.0...
Step #0 - "validate platform": - Installed hashicorp/google-beta v6.3.0 (signed by HashiCorp)
Step #0 - "validate platform": - Installing hashicorp/random v3.6.3...
Step #0 - "validate platform": - Installed hashicorp/random v3.6.3 (signed by HashiCorp)
Step #0 - "validate platform": - Installing hashicorp/helm v2.8.0...
Step #0 - "validate platform": - Installed hashicorp/helm v2.8.0 (signed by HashiCorp)
Step #0 - "validate platform":
Step #0 - "validate platform": Terraform has created a lock file .terraform.lock.hcl to record the provider
Step #0 - "validate platform": selections it made above. Include this file in your version control repository
Step #0 - "validate platform": so that Terraform can guarantee to make the same selections by default when
Step #0 - "validate platform": you run "terraform init" in the future.
Step #0 - "validate platform":
Step #0 - "validate platform": Terraform has been successfully initialized!
Step #0 - "validate platform":
Step #0 - "validate platform": You may now begin working with Terraform. Try running "terraform plan" to see
Step #0 - "validate platform": any changes that are required for your infrastructure. All Terraform commands
Step #0 - "validate platform": should now work.
Step #0 - "validate platform":
Step #0 - "validate platform": If you ever set or change modules or backend configuration for Terraform,
Step #0 - "validate platform": rerun this command to reinitialize your working directory. If you forget, other
Step #0 - "validate platform": commands will detect it and remind you to do so if necessary.
Step #0 - "validate platform": Success! The configuration is valid.
Step #0 - "validate platform":
Finished Step #0 - "validate platform"
Starting Step #1 - "validate ray"
Starting Step #2 - "validate jupyterhub"
Starting Step #3 - "validate rag"
Step #3 - "validate rag": Already have image (with digest): gcr.io/gke-ai-eco-dev/terraform
Step #2 - "validate jupyterhub": Already have image (with digest): gcr.io/gke-ai-eco-dev/terraform
Step #1 - "validate ray": Already have image (with digest): gcr.io/gke-ai-eco-dev/terraform
Step #1 - "validate ray":
Step #1 - "validate ray": Initializing the backend...
Step #1 - "validate ray": Initializing modules...
Step #1 - "validate ray": - gcs in ../../modules/gcs
Step #1 - "validate ray": - infra in ../../infrastructure
Step #1 - "validate ray": Downloading registry.terraform.io/terraform-google-modules/cloud-nat/google 5.0.0 for infra.cloud-nat...
Step #3 - "validate rag":
Step #3 - "validate rag": Initializing the backend...
Step #2 - "validate jupyterhub":
Step #2 - "validate jupyterhub": Initializing the backend...
Step #3 - "validate rag": Initializing modules...
Step #3 - "validate rag": - cloudsql in ../../modules/cloudsql
Step #2 - "validate jupyterhub": Initializing modules...
Step #2 - "validate jupyterhub": - gcs in ../../modules/gcs
Step #2 - "validate jupyterhub": - infra in ../../infrastructure
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/sql-db/google 20.0.0 for cloudsql.cloudsql...
Step #2 - "validate jupyterhub": Downloading registry.terraform.io/terraform-google-modules/cloud-nat/google 5.0.0 for infra.cloud-nat...
Step #1 - "validate ray": - infra.cloud-nat in .terraform/modules/infra.cloud-nat
Step #1 - "validate ray": - infra.custom-network in ../../modules/gcp-network
Step #1 - "validate ray": - infra.private-gke-autopilot-cluster in ../../modules/gke-autopilot-private-cluster
Step #1 - "validate ray": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.private-gke-autopilot-cluster.gke...
Step #2 - "validate jupyterhub": - infra.cloud-nat in .terraform/modules/infra.cloud-nat
Step #2 - "validate jupyterhub": - infra.custom-network in ../../modules/gcp-network
Step #2 - "validate jupyterhub": - infra.private-gke-autopilot-cluster in ../../modules/gke-autopilot-private-cluster
Step #2 - "validate jupyterhub": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.private-gke-autopilot-cluster.gke...
Step #3 - "validate rag": - cloudsql.cloudsql in .terraform/modules/cloudsql.cloudsql/modules/postgresql
Step #3 - "validate rag": - frontend in frontend
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 30.0.0 for frontend.frontend-workload-identity...
Step #1 - "validate ray": - infra.private-gke-autopilot-cluster.gke in .terraform/modules/infra.private-gke-autopilot-cluster.gke/modules/beta-autopilot-private-cluster
Step #1 - "validate ray": - infra.private-gke-standard-cluster in ../../modules/gke-standard-private-cluster
Step #1 - "validate ray": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.private-gke-standard-cluster.gke...
Step #1 - "validate ray": - infra.private-gke-standard-cluster.gke in .terraform/modules/infra.private-gke-standard-cluster.gke/modules/private-cluster
Step #1 - "validate ray": - infra.public-gke-autopilot-cluster in ../../modules/gke-autopilot-public-cluster
Step #1 - "validate ray": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.public-gke-autopilot-cluster.gke...
Step #1 - "validate ray": - infra.public-gke-autopilot-cluster.gke in .terraform/modules/infra.public-gke-autopilot-cluster.gke/modules/beta-autopilot-public-cluster
Step #1 - "validate ray": - infra.public-gke-standard-cluster in ../../modules/gke-standard-public-cluster
Step #1 - "validate ray": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.public-gke-standard-cluster.gke...
Step #1 - "validate ray": - infra.public-gke-standard-cluster.gke in .terraform/modules/infra.public-gke-standard-cluster.gke
Step #1 - "validate ray": - kuberay-cluster in ../../modules/kuberay-cluster
Step #1 - "validate ray": - kuberay-cluster.iap_auth in ../../modules/iap
Step #1 - "validate ray": - kuberay-monitoring in ../../modules/kuberay-monitoring
Step #1 - "validate ray": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 30.0.0 for kuberay-workload-identity...
Step #2 - "validate jupyterhub": - infra.private-gke-autopilot-cluster.gke in .terraform/modules/infra.private-gke-autopilot-cluster.gke/modules/beta-autopilot-private-cluster
Step #2 - "validate jupyterhub": - infra.private-gke-standard-cluster in ../../modules/gke-standard-private-cluster
Step #2 - "validate jupyterhub": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.private-gke-standard-cluster.gke...
Step #2 - "validate jupyterhub": - infra.private-gke-standard-cluster.gke in .terraform/modules/infra.private-gke-standard-cluster.gke/modules/private-cluster
Step #2 - "validate jupyterhub": - infra.public-gke-autopilot-cluster in ../../modules/gke-autopilot-public-cluster
Step #2 - "validate jupyterhub": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.public-gke-autopilot-cluster.gke...
Step #2 - "validate jupyterhub": - infra.public-gke-autopilot-cluster.gke in .terraform/modules/infra.public-gke-autopilot-cluster.gke/modules/beta-autopilot-public-cluster
Step #2 - "validate jupyterhub": - infra.public-gke-standard-cluster in ../../modules/gke-standard-public-cluster
Step #2 - "validate jupyterhub": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.public-gke-standard-cluster.gke...
Step #3 - "validate rag": - frontend.frontend-workload-identity in .terraform/modules/frontend.frontend-workload-identity/modules/workload-identity
Step #2 - "validate jupyterhub": - infra.public-gke-standard-cluster.gke in .terraform/modules/infra.public-gke-standard-cluster.gke
Step #2 - "validate jupyterhub": - jupyterhub in ../../modules/jupyter
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/gcloud/google 3.5.0 for frontend.frontend-workload-identity.annotate-sa...
Step #2 - "validate jupyterhub": - jupyterhub.iap_auth in ../../modules/iap
Step #2 - "validate jupyterhub": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 30.0.0 for jupyterhub.jupyterhub-workload-identity...
Step #3 - "validate rag": - frontend.frontend-workload-identity.annotate-sa in .terraform/modules/frontend.frontend-workload-identity.annotate-sa/modules/kubectl-wrapper
Step #3 - "validate rag": - frontend.frontend-workload-identity.annotate-sa.gcloud_kubectl in .terraform/modules/frontend.frontend-workload-identity.annotate-sa
Step #3 - "validate rag": - frontend.iap_auth in ../../modules/iap
Step #3 - "validate rag": - gcs in ../../modules/gcs
Step #3 - "validate rag": - inference-server in ../../modules/inference-service
Step #3 - "validate rag": - infra in ../../infrastructure
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/cloud-nat/google 5.0.0 for infra.cloud-nat...
Step #1 - "validate ray": - kuberay-workload-identity in .terraform/modules/kuberay-workload-identity/modules/workload-identity
Step #1 - "validate ray": Downloading registry.terraform.io/terraform-google-modules/gcloud/google 3.5.0 for kuberay-workload-identity.annotate-sa...
Step #3 - "validate rag": - infra.cloud-nat in .terraform/modules/infra.cloud-nat
Step #3 - "validate rag": - infra.custom-network in ../../modules/gcp-network
Step #3 - "validate rag": - infra.private-gke-autopilot-cluster in ../../modules/gke-autopilot-private-cluster
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.private-gke-autopilot-cluster.gke...
Step #2 - "validate jupyterhub": - jupyterhub.jupyterhub-workload-identity in .terraform/modules/jupyterhub.jupyterhub-workload-identity/modules/workload-identity
Step #2 - "validate jupyterhub": Downloading registry.terraform.io/terraform-google-modules/gcloud/google 3.5.0 for jupyterhub.jupyterhub-workload-identity.annotate-sa...
Step #1 - "validate ray": - kuberay-workload-identity.annotate-sa in .terraform/modules/kuberay-workload-identity.annotate-sa/modules/kubectl-wrapper
Step #1 - "validate ray": - kuberay-workload-identity.annotate-sa.gcloud_kubectl in .terraform/modules/kuberay-workload-identity.annotate-sa
Step #1 - "validate ray": - namespace in ../../modules/kubernetes-namespace
Step #1 - "validate ray": Downloading registry.terraform.io/terraform-google-modules/project-factory/google 14.5.0 for project-services...
Step #2 - "validate jupyterhub": - jupyterhub.jupyterhub-workload-identity.annotate-sa in .terraform/modules/jupyterhub.jupyterhub-workload-identity.annotate-sa/modules/kubectl-wrapper
Step #2 - "validate jupyterhub": - jupyterhub.jupyterhub-workload-identity.annotate-sa.gcloud_kubectl in .terraform/modules/jupyterhub.jupyterhub-workload-identity.annotate-sa
Step #2 - "validate jupyterhub": - namespace in ../../modules/kubernetes-namespace
Step #2 - "validate jupyterhub": Downloading registry.terraform.io/terraform-google-modules/project-factory/google 14.5.0 for project-services...
Step #1 - "validate ray": - project-services in .terraform/modules/project-services/modules/project_services
Step #1 - "validate ray":
Step #1 - "validate ray": Initializing provider plugins...
Step #1 - "validate ray": - terraform.io/builtin/terraform is built in to Terraform
Step #1 - "validate ray": - Finding hashicorp/google-beta versions matching ">= 3.43.0, >= 5.40.0, != 5.44.0, < 6.0.0, != 6.2.0, < 7.0.0"...
Step #1 - "validate ray": - Finding hashicorp/external versions matching ">= 2.2.2"...
Step #3 - "validate rag": - infra.private-gke-autopilot-cluster.gke in .terraform/modules/infra.private-gke-autopilot-cluster.gke/modules/beta-autopilot-private-cluster
Step #3 - "validate rag": - infra.private-gke-standard-cluster in ../../modules/gke-standard-private-cluster
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.private-gke-standard-cluster.gke...
Step #1 - "validate ray": - Finding hashicorp/random versions matching ">= 2.1.0, ~> 3.0"...
Step #1 - "validate ray": - Finding hashicorp/null versions matching ">= 2.1.0"...
Step #3 - "validate rag": - infra.private-gke-standard-cluster.gke in .terraform/modules/infra.private-gke-standard-cluster.gke/modules/private-cluster
Step #3 - "validate rag": - infra.public-gke-autopilot-cluster in ../../modules/gke-autopilot-public-cluster
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.public-gke-autopilot-cluster.gke...
Step #1 - "validate ray": - Finding hashicorp/helm versions matching "~> 2.8.0"...
Step #1 - "validate ray": - Finding hashicorp/kubernetes versions matching "~> 2.10, ~> 2.13, 2.18.1"...
Step #3 - "validate rag": - infra.public-gke-autopilot-cluster.gke in .terraform/modules/infra.public-gke-autopilot-cluster.gke/modules/beta-autopilot-public-cluster
Step #3 - "validate rag": - infra.public-gke-standard-cluster in ../../modules/gke-standard-public-cluster
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 33.0.0 for infra.public-gke-standard-cluster.gke...
Step #1 - "validate ray": - Finding hashicorp/time versions matching "0.11.1"...
Step #3 - "validate rag": - infra.public-gke-standard-cluster.gke in .terraform/modules/infra.public-gke-standard-cluster.gke
Step #3 - "validate rag": - jupyterhub in ../../modules/jupyter
Step #3 - "validate rag": - jupyterhub.iap_auth in ../../modules/iap
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 30.0.0 for jupyterhub.jupyterhub-workload-identity...
Step #1 - "validate ray": - Finding hashicorp/google versions matching ">= 3.39.0, >= 3.43.0, >= 3.53.0, >= 4.51.0, >= 5.40.0, != 5.44.0, < 6.0.0, < 7.0.0"...
Step #2 - "validate jupyterhub": - project-services in .terraform/modules/project-services/modules/project_services
Step #2 - "validate jupyterhub":
Step #2 - "validate jupyterhub": Initializing provider plugins...
Step #2 - "validate jupyterhub": - terraform.io/builtin/terraform is built in to Terraform
Step #2 - "validate jupyterhub": - Finding hashicorp/google-beta versions matching ">= 3.43.0, >= 5.40.0, != 5.44.0, < 6.0.0, != 6.2.0, < 7.0.0"...
Step #3 - "validate rag": - jupyterhub.jupyterhub-workload-identity in .terraform/modules/jupyterhub.jupyterhub-workload-identity/modules/workload-identity
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/gcloud/google 3.5.0 for jupyterhub.jupyterhub-workload-identity.annotate-sa...
Step #3 - "validate rag": - jupyterhub.jupyterhub-workload-identity.annotate-sa in .terraform/modules/jupyterhub.jupyterhub-workload-identity.annotate-sa/modules/kubectl-wrapper
Step #3 - "validate rag": - jupyterhub.jupyterhub-workload-identity.annotate-sa.gcloud_kubectl in .terraform/modules/jupyterhub.jupyterhub-workload-identity.annotate-sa
Step #3 - "validate rag": - kuberay-cluster in ../../modules/kuberay-cluster
Step #3 - "validate rag": - kuberay-cluster.iap_auth in ../../modules/iap
Step #3 - "validate rag": - kuberay-monitoring in ../../modules/kuberay-monitoring
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/kubernetes-engine/google 30.0.0 for kuberay-workload-identity...
Step #2 - "validate jupyterhub": - Finding hashicorp/helm versions matching "~> 2.8.0"...
Step #3 - "validate rag": - kuberay-workload-identity in .terraform/modules/kuberay-workload-identity/modules/workload-identity
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/gcloud/google 3.5.0 for kuberay-workload-identity.annotate-sa...
Step #2 - "validate jupyterhub": - Finding hashicorp/random versions matching ">= 2.1.0, ~> 3.0"...
Step #3 - "validate rag": - kuberay-workload-identity.annotate-sa in .terraform/modules/kuberay-workload-identity.annotate-sa/modules/kubectl-wrapper
Step #3 - "validate rag": - kuberay-workload-identity.annotate-sa.gcloud_kubectl in .terraform/modules/kuberay-workload-identity.annotate-sa
Step #3 - "validate rag": - namespace in ../../modules/kubernetes-namespace
Step #3 - "validate rag": Downloading registry.terraform.io/terraform-google-modules/project-factory/google 14.5.0 for project-services...
Step #1 - "validate ray": - Installing hashicorp/helm v2.8.0...
Step #2 - "validate jupyterhub": - Finding hashicorp/null versions matching ">= 2.1.0"...
Step #2 - "validate jupyterhub": - Finding hashicorp/external versions matching ">= 2.2.2"...
Step #2 - "validate jupyterhub": - Finding hashicorp/kubernetes versions matching "~> 2.10, ~> 2.13, 2.18.1"...
Step #2 - "validate jupyterhub": - Finding hashicorp/google versions matching ">= 3.39.0, >= 3.43.0, >= 3.53.0, >= 4.51.0, >= 5.40.0, != 5.44.0, < 6.0.0, < 7.0.0"...
Step #2 - "validate jupyterhub": - Installing hashicorp/null v3.2.3...
Step #3 - "validate rag": - project-services in .terraform/modules/project-services/modules/project_services
Step #3 - "validate rag":
Step #3 - "validate rag": Initializing provider plugins...
Step #3 - "validate rag": - terraform.io/builtin/terraform is built in to Terraform
Step #3 - "validate rag": - Finding hashicorp/random versions matching ">= 2.1.0, ~> 3.0, ~> 3.1"...
Step #3 - "validate rag": - Finding hashicorp/null versions matching ">= 2.1.0, ~> 3.1"...
Step #2 - "validate jupyterhub": - Installed hashicorp/null v3.2.3 (signed by HashiCorp)
Step #3 - "validate rag": - Finding hashicorp/time versions matching "0.11.1"...
Step #3 - "validate rag": - Finding hashicorp/google-beta versions matching ">= 3.43.0, >= 5.12.0, >= 5.40.0, != 5.44.0, < 6.0.0, != 6.2.0, < 7.0.0"...
Step #2 - "validate jupyterhub": - Installing hashicorp/external v2.3.4...
Step #3 - "validate rag": - Finding hashicorp/kubernetes versions matching "~> 2.10, ~> 2.13, 2.18.1"...
Step #1 - "validate ray": - Installed hashicorp/helm v2.8.0 (signed by HashiCorp)
Step #3 - "validate rag": - Finding hashicorp/external versions matching ">= 2.2.2"...
Step #3 - "validate rag": - Finding hashicorp/google versions matching ">= 3.39.0, >= 3.43.0, >= 3.53.0, >= 4.51.0, >= 5.12.0, >= 5.40.0, != 5.44.0, < 6.0.0, < 7.0.0"...
Step #1 - "validate ray": - Installing hashicorp/kubernetes v2.18.1...
Step #3 - "validate rag": - Finding hashicorp/helm versions matching "~> 2.8.0"...
Step #3 - "validate rag": - Installing hashicorp/null v3.2.3...
Step #2 - "validate jupyterhub": - Installed hashicorp/external v2.3.4 (signed by HashiCorp)
Step #2 - "validate jupyterhub": - Installing hashicorp/kubernetes v2.18.1...
Step #3 - "validate rag": - Installed hashicorp/null v3.2.3 (signed by HashiCorp)
Step #3 - "validate rag": - Installing hashicorp/time v0.11.1...
Step #1 - "validate ray": - Installed hashicorp/kubernetes v2.18.1 (signed by HashiCorp)
Step #1 - "validate ray": - Installing hashicorp/time v0.11.1...
Step #3 - "validate rag": - Installed hashicorp/time v0.11.1 (signed by HashiCorp)
Step #2 - "validate jupyterhub": - Installed hashicorp/kubernetes v2.18.1 (signed by HashiCorp)
Step #3 - "validate rag": - Installing hashicorp/google-beta v5.43.1...
Step #2 - "validate jupyterhub": - Installing hashicorp/google v5.43.1...
Step #1 - "validate ray": - Installed hashicorp/time v0.11.1 (signed by HashiCorp)
Step #1 - "validate ray": - Installing hashicorp/google v5.43.1...
Step #3 - "validate rag": - Installed hashicorp/google-beta v5.43.1 (signed by HashiCorp)
Step #2 - "validate jupyterhub": - Installed hashicorp/google v5.43.1 (signed by HashiCorp)
Step #3 - "validate rag": - Installing hashicorp/kubernetes v2.18.1...
Step #1 - "validate ray": - Installed hashicorp/google v5.43.1 (signed by HashiCorp)
Step #2 - "validate jupyterhub": - Installing hashicorp/google-beta v5.43.1...
Step #1 - "validate ray": - Installing hashicorp/google-beta v5.43.1...
Step #3 - "validate rag": - Installed hashicorp/kubernetes v2.18.1 (signed by HashiCorp)
Step #3 - "validate rag": - Installing hashicorp/external v2.3.4...
Step #3 - "validate rag": - Installed hashicorp/external v2.3.4 (signed by HashiCorp)
Step #3 - "validate rag": - Installing hashicorp/google v5.43.1...
Step #2 - "validate jupyterhub": - Installed hashicorp/google-beta v5.43.1 (signed by HashiCorp)
Step #2 - "validate jupyterhub": - Installing hashicorp/helm v2.8.0...
Step #1 - "validate ray": - Installed hashicorp/google-beta v5.43.1 (signed by HashiCorp)
Step #1 - "validate ray": - Installing hashicorp/external v2.3.4...
Step #1 - "validate ray": - Installed hashicorp/external v2.3.4 (signed by HashiCorp)
Step #1 - "validate ray": - Installing hashicorp/random v3.6.3...
Step #2 - "validate jupyterhub": - Installed hashicorp/helm v2.8.0 (signed by HashiCorp)
Step #2 - "validate jupyterhub": - Installing hashicorp/random v3.6.3...
Step #1 - "validate ray": - Installed hashicorp/random v3.6.3 (signed by HashiCorp)
Step #1 - "validate ray": - Installing hashicorp/null v3.2.3...
Step #3 - "validate rag": - Installed hashicorp/google v5.43.1 (signed by HashiCorp)
Step #2 - "validate jupyterhub": - Installed hashicorp/random v3.6.3 (signed by HashiCorp)
Step #2 - "validate jupyterhub":
Step #2 - "validate jupyterhub": Terraform has created a lock file .terraform.lock.hcl to record the provider
Step #2 - "validate jupyterhub": selections it made above. Include this file in your version control repository
Step #2 - "validate jupyterhub": so that Terraform can guarantee to make the same selections by default when
Step #2 - "validate jupyterhub": you run "terraform init" in the future.
Step #2 - "validate jupyterhub":
Step #2 - "validate jupyterhub": Terraform has been successfully initialized!
Step #2 - "validate jupyterhub":
Step #2 - "validate jupyterhub": You may now begin working with Terraform. Try running "terraform plan" to see
Step #2 - "validate jupyterhub": any changes that are required for your infrastructure. All Terraform commands
Step #2 - "validate jupyterhub": should now work.
Step #2 - "validate jupyterhub":
Step #2 - "validate jupyterhub": If you ever set or change modules or backend configuration for Terraform,
Step #2 - "validate jupyterhub": rerun this command to reinitialize your working directory. If you forget, other
Step #2 - "validate jupyterhub": commands will detect it and remind you to do so if necessary.
Step #3 - "validate rag": - Installing hashicorp/helm v
...
[Logs truncated due to log size limitations. For full logs, see https://storage.cloud.google.com/ai-on-gke-build-logs/log-d14da3ce-778d-42e6-b6d0-0923c2072127.txt.]
...
ject-services.google_project_service.project_services["autoscaling.googleapis.com"]: Creating...
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["containerfilesystem.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/containerfilesystem.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["gkehub.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/gkehub.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["config.googleapis.com"]: Creating...
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["iap.googleapis.com"]: Creation complete after 3s [id=gke-ai-eco-dev/iap.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["iamcredentials.googleapis.com"]: Creating...
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["monitoring.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/monitoring.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["cloudresourcemanager.googleapis.com"]: Creating...
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["logging.googleapis.com"]: Creating...
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["dns.googleapis.com"]: Creating...
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["servicenetworking.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/servicenetworking.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["autoscaling.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/autoscaling.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["dns.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/dns.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["config.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/config.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["cloudresourcemanager.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/cloudresourcemanager.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["iamcredentials.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/iamcredentials.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["logging.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/logging.googleapis.com]
Step #7 - "test jupyterhub": module.project-services.google_project_service.project_services["pubsub.googleapis.com"]: Creation complete after 4s [id=gke-ai-eco-dev/pubsub.googleapis.com]
Step #7 - "test jupyterhub": data.google_container_cluster.default[0]: Reading...
Step #7 - "test jupyterhub":
Step #7 - "test jupyterhub": Error: projects/gke-ai-eco-dev/locations/us-east4/clusters/ml-c5a4669-816-d14da3ce-cluster not found
Step #7 - "test jupyterhub":
Step #7 - "test jupyterhub": with data.google_container_cluster.default[0],
Step #7 - "test jupyterhub": on main.tf line 75, in data "google_container_cluster" "default":
Step #7 - "test jupyterhub": 75: data "google_container_cluster" "default" {
Step #7 - "test jupyterhub":
Finished Step #7 - "test jupyterhub"
ERROR: step exited with non-zero status: 1
Starting Step #8 - "cleanup jupyterhub"
Step #8 - "cleanup jupyterhub": Already have image (with digest): gcr.io/gke-ai-eco-dev/terraform
Step #8 - "cleanup jupyterhub": data.google_project.project: Reading...
Step #8 - "cleanup jupyterhub": data.google_client_config.default: Reading...
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["cloudbuild.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/cloudbuild.googleapis.com]
Step #8 - "cleanup jupyterhub": module.gcs[0].google_storage_bucket.static: Refreshing state... [id=gke-aieco-jupyter-c5a4669-d14da3ce]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["containerfilesystem.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/containerfilesystem.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["sourcerepo.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/sourcerepo.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["servicenetworking.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/servicenetworking.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["logging.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/logging.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["pubsub.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/pubsub.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["autoscaling.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/autoscaling.googleapis.com]
Step #8 - "cleanup jupyterhub": data.google_client_config.default: Read complete after 0s [id=projects/"gke-ai-eco-dev"/regions/<null>/zones/<null>]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["dns.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/dns.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["iap.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/iap.googleapis.com]
Step #8 - "cleanup jupyterhub": data.google_project.project: Read complete after 0s [id=projects/gke-ai-eco-dev]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["connectgateway.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/connectgateway.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["gkehub.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/gkehub.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["cloudresourcemanager.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/cloudresourcemanager.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["container.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/container.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["compute.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/compute.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["serviceusage.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/serviceusage.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["monitoring.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/monitoring.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["iamcredentials.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/iamcredentials.googleapis.com]
Step #8 - "cleanup jupyterhub": module.project-services.google_project_service.project_services["config.googleapis.com"]: Refreshing state... [id=gke-ai-eco-dev/config.googleapis.com]
Step #8 - "cleanup jupyterhub": data.google_container_cluster.default[0]: Reading...
Step #8 - "cleanup jupyterhub":
Step #8 - "cleanup jupyterhub": Error: projects/gke-ai-eco-dev/locations/us-east4/clusters/ml-c5a4669-816-d14da3ce-cluster not found
Step #8 - "cleanup jupyterhub":
Step #8 - "cleanup jupyterhub": with data.google_container_cluster.default[0],
Step #8 - "cleanup jupyterhub": on main.tf line 75, in data "google_container_cluster" "default":
Step #8 - "cleanup jupyterhub": 75: data "google_container_cluster" "default" {
Step #8 - "cleanup jupyterhub":
Finished Step #8 - "cleanup jupyterhub"
ERROR: step exited with non-zero status: 1
Starting Step #11 - "cleanup gke cluster"
Step #11 - "cleanup gke cluster": Already have image (with digest): gcr.io/gke-ai-eco-dev/terraform
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_network.network: Refreshing state... [id=projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_subnetwork.subnetwork["us-east4/ml-c5a4669-816-d14da3ce-true"]: Refreshing state... [id=projects/gke-ai-eco-dev/regions/us-east4/subnetworks/ml-c5a4669-816-d14da3ce-true]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_global_address.google-managed-services-range[0]: Refreshing state... [id=projects/gke-ai-eco-dev/global/addresses/google-managed-services-ml-c5a4669-816-d14da3ce-true]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_service_networking_connection.private_service_access[0]: Refreshing state... [id=https%3A%2F%2Fwww.googleapis.com%2Fcompute%2Fv1%2Fprojects%2Fgke-ai-eco-dev%2Fglobal%2Fnetworks%2Fml-c5a4669-816-d14da3ce-true:servicenetworking.googleapis.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.random_string.cluster_service_account_suffix[0]: Refreshing state... [id=0ok0]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.data.google_container_engine_versions.zone: Reading...
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.data.google_container_engine_versions.region: Reading...
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_service_account.cluster_service_account[0]: Refreshing state... [id=projects/gke-ai-eco-dev/serviceAccounts/tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-resourceMetadata-writer[0]: Refreshing state... [id=gke-ai-eco-dev/roles/stackdriver.resourceMetadata.writer/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-nodeService_account[0]: Refreshing state... [id=gke-ai-eco-dev/roles/container.defaultNodeServiceAccount/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-metric_writer[0]: Refreshing state... [id=gke-ai-eco-dev/roles/monitoring.metricWriter/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.data.google_container_engine_versions.region: Read complete after 0s [id=2024-09-17 17:05:17.146196983 +0000 UTC]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.data.google_container_engine_versions.zone: Read complete after 0s [id=2024-09-17 17:05:17.151438353 +0000 UTC]
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": Terraform used the selected providers to generate the following execution
Step #11 - "cleanup gke cluster": plan. Resource actions are indicated with the following symbols:
Step #11 - "cleanup gke cluster": - destroy
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": Terraform will perform the following actions:
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.custom-network[0].google_compute_global_address.google-managed-services-range[0] will be destroyed
Step #11 - "cleanup gke cluster": - resource "google_compute_global_address" "google-managed-services-range" {
Step #11 - "cleanup gke cluster": - address = "10.8.0.0" -> null
Step #11 - "cleanup gke cluster": - address_type = "INTERNAL" -> null
Step #11 - "cleanup gke cluster": - creation_timestamp = "2024-09-17T10:03:07.138-07:00" -> null
Step #11 - "cleanup gke cluster": - effective_labels = {} -> null
Step #11 - "cleanup gke cluster": - id = "projects/gke-ai-eco-dev/global/addresses/google-managed-services-ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - label_fingerprint = "42WmSpB8rSM=" -> null
Step #11 - "cleanup gke cluster": - labels = {} -> null
Step #11 - "cleanup gke cluster": - name = "google-managed-services-ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - network = "https://www.googleapis.com/compute/v1/projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - prefix_length = 16 -> null
Step #11 - "cleanup gke cluster": - project = "gke-ai-eco-dev" -> null
Step #11 - "cleanup gke cluster": - purpose = "VPC_PEERING" -> null
Step #11 - "cleanup gke cluster": - self_link = "https://www.googleapis.com/compute/v1/projects/gke-ai-eco-dev/global/addresses/google-managed-services-ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - terraform_labels = {} -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.custom-network[0].google_compute_network.network will be destroyed
Step #11 - "cleanup gke cluster": - resource "google_compute_network" "network" {
Step #11 - "cleanup gke cluster": - auto_create_subnetworks = false -> null
Step #11 - "cleanup gke cluster": - delete_default_routes_on_create = false -> null
Step #11 - "cleanup gke cluster": - enable_ula_internal_ipv6 = false -> null
Step #11 - "cleanup gke cluster": - id = "projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - mtu = 0 -> null
Step #11 - "cleanup gke cluster": - name = "ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - network_firewall_policy_enforcement_order = "AFTER_CLASSIC_FIREWALL" -> null
Step #11 - "cleanup gke cluster": - numeric_id = "3414147572007438554" -> null
Step #11 - "cleanup gke cluster": - project = "gke-ai-eco-dev" -> null
Step #11 - "cleanup gke cluster": - routing_mode = "GLOBAL" -> null
Step #11 - "cleanup gke cluster": - self_link = "https://www.googleapis.com/compute/v1/projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.custom-network[0].google_compute_subnetwork.subnetwork["us-east4/ml-c5a4669-816-d14da3ce-true"] will be destroyed
Step #11 - "cleanup gke cluster": - resource "google_compute_subnetwork" "subnetwork" {
Step #11 - "cleanup gke cluster": - creation_timestamp = "2024-09-17T10:03:07.328-07:00" -> null
Step #11 - "cleanup gke cluster": - gateway_address = "10.128.0.1" -> null
Step #11 - "cleanup gke cluster": - id = "projects/gke-ai-eco-dev/regions/us-east4/subnetworks/ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - ip_cidr_range = "10.128.0.0/20" -> null
Step #11 - "cleanup gke cluster": - name = "ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - network = "https://www.googleapis.com/compute/v1/projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - private_ip_google_access = true -> null
Step #11 - "cleanup gke cluster": - private_ipv6_google_access = "DISABLE_GOOGLE_ACCESS" -> null
Step #11 - "cleanup gke cluster": - project = "gke-ai-eco-dev" -> null
Step #11 - "cleanup gke cluster": - purpose = "PRIVATE" -> null
Step #11 - "cleanup gke cluster": - region = "us-east4" -> null
Step #11 - "cleanup gke cluster": - secondary_ip_range = [] -> null
Step #11 - "cleanup gke cluster": - self_link = "https://www.googleapis.com/compute/v1/projects/gke-ai-eco-dev/regions/us-east4/subnetworks/ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - stack_type = "IPV4_ONLY" -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.custom-network[0].google_service_networking_connection.private_service_access[0] will be destroyed
Step #11 - "cleanup gke cluster": - resource "google_service_networking_connection" "private_service_access" {
Step #11 - "cleanup gke cluster": - deletion_policy = "ABANDON" -> null
Step #11 - "cleanup gke cluster": - id = "https%3A%2F%2Fwww.googleapis.com%2Fcompute%2Fv1%2Fprojects%2Fgke-ai-eco-dev%2Fglobal%2Fnetworks%2Fml-c5a4669-816-d14da3ce-true:servicenetworking.googleapis.com" -> null
Step #11 - "cleanup gke cluster": - network = "https://www.googleapis.com/compute/v1/projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true" -> null
Step #11 - "cleanup gke cluster": - peering = "servicenetworking-googleapis-com" -> null
Step #11 - "cleanup gke cluster": - reserved_peering_ranges = [
Step #11 - "cleanup gke cluster": - "google-managed-services-ml-c5a4669-816-d14da3ce-true",
Step #11 - "cleanup gke cluster": ] -> null
Step #11 - "cleanup gke cluster": - service = "servicenetworking.googleapis.com" -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-metric_writer[0] will be destroyed
Step #11 - "cleanup gke cluster": - resource "google_project_iam_member" "cluster_service_account-metric_writer" {
Step #11 - "cleanup gke cluster": - etag = "BwYiU68bTLQ=" -> null
Step #11 - "cleanup gke cluster": - id = "gke-ai-eco-dev/roles/monitoring.metricWriter/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - member = "serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - project = "gke-ai-eco-dev" -> null
Step #11 - "cleanup gke cluster": - role = "roles/monitoring.metricWriter" -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-nodeService_account[0] will be destroyed
Step #11 - "cleanup gke cluster": - resource "google_project_iam_member" "cluster_service_account-nodeService_account" {
Step #11 - "cleanup gke cluster": - etag = "BwYiU68bTLQ=" -> null
Step #11 - "cleanup gke cluster": - id = "gke-ai-eco-dev/roles/container.defaultNodeServiceAccount/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - member = "serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - project = "gke-ai-eco-dev" -> null
Step #11 - "cleanup gke cluster": - role = "roles/container.defaultNodeServiceAccount" -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-resourceMetadata-writer[0] will be destroyed
Step #11 - "cleanup gke cluster": - resource "google_project_iam_member" "cluster_service_account-resourceMetadata-writer" {
Step #11 - "cleanup gke cluster": - etag = "BwYiU68bTLQ=" -> null
Step #11 - "cleanup gke cluster": - id = "gke-ai-eco-dev/roles/stackdriver.resourceMetadata.writer/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - member = "serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - project = "gke-ai-eco-dev" -> null
Step #11 - "cleanup gke cluster": - role = "roles/stackdriver.resourceMetadata.writer" -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.public-gke-autopilot-cluster[0].module.gke.google_service_account.cluster_service_account[0] will be destroyed
Step #11 - "cleanup gke cluster": - resource "google_service_account" "cluster_service_account" {
Step #11 - "cleanup gke cluster": - account_id = "tf-gke-ml-c5a4669-816--0ok0" -> null
Step #11 - "cleanup gke cluster": - disabled = false -> null
Step #11 - "cleanup gke cluster": - display_name = "Terraform-managed service account for cluster ml-c5a4669-816-d14da3ce-cluster" -> null
Step #11 - "cleanup gke cluster": - email = "tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - id = "projects/gke-ai-eco-dev/serviceAccounts/tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - member = "serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - name = "projects/gke-ai-eco-dev/serviceAccounts/tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com" -> null
Step #11 - "cleanup gke cluster": - project = "gke-ai-eco-dev" -> null
Step #11 - "cleanup gke cluster": - unique_id = "110382671008825743819" -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": # module.public-gke-autopilot-cluster[0].module.gke.random_string.cluster_service_account_suffix[0] will be destroyed
Step #11 - "cleanup gke cluster": - resource "random_string" "cluster_service_account_suffix" {
Step #11 - "cleanup gke cluster": - id = "0ok0" -> null
Step #11 - "cleanup gke cluster": - length = 4 -> null
Step #11 - "cleanup gke cluster": - lower = true -> null
Step #11 - "cleanup gke cluster": - min_lower = 0 -> null
Step #11 - "cleanup gke cluster": - min_numeric = 0 -> null
Step #11 - "cleanup gke cluster": - min_special = 0 -> null
Step #11 - "cleanup gke cluster": - min_upper = 0 -> null
Step #11 - "cleanup gke cluster": - number = true -> null
Step #11 - "cleanup gke cluster": - numeric = true -> null
Step #11 - "cleanup gke cluster": - result = "0ok0" -> null
Step #11 - "cleanup gke cluster": - special = false -> null
Step #11 - "cleanup gke cluster": - upper = false -> null
Step #11 - "cleanup gke cluster": }
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": Plan: 0 to add, 0 to change, 9 to destroy.
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": Changes to Outputs:
Step #11 - "cleanup gke cluster": - cluster_location = "us-east4" -> null
Step #11 - "cleanup gke cluster": - cluster_name = "ml-c5a4669-816-d14da3ce-cluster" -> null
Step #11 - "cleanup gke cluster": - private_cluster = false -> null
Step #11 - "cleanup gke cluster": - project_id = "gke-ai-eco-dev" -> null
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-nodeService_account[0]: Destroying... [id=gke-ai-eco-dev/roles/container.defaultNodeServiceAccount/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-resourceMetadata-writer[0]: Destroying... [id=gke-ai-eco-dev/roles/stackdriver.resourceMetadata.writer/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-metric_writer[0]: Destroying... [id=gke-ai-eco-dev/roles/monitoring.metricWriter/serviceAccount:tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-metric_writer[0]: Destruction complete after 8s
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-resourceMetadata-writer[0]: Destruction complete after 8s
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_project_iam_member.cluster_service_account-nodeService_account[0]: Destruction complete after 8s
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_service_account.cluster_service_account[0]: Destroying... [id=projects/gke-ai-eco-dev/serviceAccounts/tf-gke-ml-c5a4669-816--0ok0@gke-ai-eco-dev.iam.gserviceaccount.com]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.google_service_account.cluster_service_account[0]: Destruction complete after 1s
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.random_string.cluster_service_account_suffix[0]: Destroying... [id=0ok0]
Step #11 - "cleanup gke cluster": module.public-gke-autopilot-cluster[0].module.gke.random_string.cluster_service_account_suffix[0]: Destruction complete after 0s
Step #11 - "cleanup gke cluster": module.custom-network[0].google_service_networking_connection.private_service_access[0]: Destroying... [id=https%3A%2F%2Fwww.googleapis.com%2Fcompute%2Fv1%2Fprojects%2Fgke-ai-eco-dev%2Fglobal%2Fnetworks%2Fml-c5a4669-816-d14da3ce-true:servicenetworking.googleapis.com]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_subnetwork.subnetwork["us-east4/ml-c5a4669-816-d14da3ce-true"]: Destroying... [id=projects/gke-ai-eco-dev/regions/us-east4/subnetworks/ml-c5a4669-816-d14da3ce-true]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_service_networking_connection.private_service_access[0]: Destruction complete after 0s
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_global_address.google-managed-services-range[0]: Destroying... [id=projects/gke-ai-eco-dev/global/addresses/google-managed-services-ml-c5a4669-816-d14da3ce-true]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_subnetwork.subnetwork["us-east4/ml-c5a4669-816-d14da3ce-true"]: Still destroying... [id=projects/gke-ai-eco-dev/regions/us-east...bnetworks/ml-c5a4669-816-d14da3ce-true, 10s elapsed]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_global_address.google-managed-services-range[0]: Still destroying... [id=projects/gke-ai-eco-dev/global/addresse...-services-ml-c5a4669-816-d14da3ce-true, 10s elapsed]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_global_address.google-managed-services-range[0]: Destruction complete after 10s
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_subnetwork.subnetwork["us-east4/ml-c5a4669-816-d14da3ce-true"]: Still destroying... [id=projects/gke-ai-eco-dev/regions/us-east...bnetworks/ml-c5a4669-816-d14da3ce-true, 20s elapsed]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_subnetwork.subnetwork["us-east4/ml-c5a4669-816-d14da3ce-true"]: Still destroying... [id=projects/gke-ai-eco-dev/regions/us-east...bnetworks/ml-c5a4669-816-d14da3ce-true, 30s elapsed]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_subnetwork.subnetwork["us-east4/ml-c5a4669-816-d14da3ce-true"]: Destruction complete after 30s
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_network.network: Destroying... [id=projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_network.network: Still destroying... [id=projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true, 10s elapsed]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_network.network: Still destroying... [id=projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true, 20s elapsed]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_network.network: Still destroying... [id=projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true, 30s elapsed]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_network.network: Still destroying... [id=projects/gke-ai-eco-dev/global/networks/ml-c5a4669-816-d14da3ce-true, 40s elapsed]
Step #11 - "cleanup gke cluster": module.custom-network[0].google_compute_network.network: Destruction complete after 42s
Step #11 - "cleanup gke cluster":
Step #11 - "cleanup gke cluster": Destroy complete! Resources: 9 destroyed.
Finished Step #11 - "cleanup gke cluster"
Starting Step #12 - "check result"
Step #12 - "check result": Already have image (with digest): gcr.io/gke-ai-eco-dev/terraform
Step #12 - "check result": cat: /workspace/gke_cluster_result.txt: No such file or directory
Step #12 - "check result": gke cluster creation failed
Finished Step #12 - "check result"
ERROR
ERROR: build step 12 "gcr.io/gke-ai-eco-dev/terraform" failed: step exited with non-zero status: 1
Build Log: https://storage.cloud.google.com/ai-on-gke-build-logs/log-d14da3ce-778d-42e6-b6d0-0923c2072127.txt
Loading