Skip to content

Commit

Permalink
fix numpy error in logs, run terraform fmt
Browse files Browse the repository at this point in the history
  • Loading branch information
annapendleton committed Sep 4, 2024
1 parent f0e245e commit 26242b1
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ ninja # For faster builds.
psutil
ray >= 2.9
sentencepiece # Required for LLaMA tokenizer.
numpy
numpy < 2.0
torch == 2.1.1
transformers >= 4.37.0 # Required for Qwen2
xformers == 0.0.23
Expand Down
2 changes: 1 addition & 1 deletion benchmarks/inference-server/vllm/main.tf
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ locals {
? null
: "${var.hugging_face_secret}/versions/${var.hugging_face_secret_version}"
)
vllm_podmonitoring = "${path.module}/monitoring-templates/vllm-podmonitoring.yaml.tftpl"
vllm_podmonitoring = "${path.module}/monitoring-templates/vllm-podmonitoring.yaml.tftpl"
}

resource "kubernetes_manifest" "default" {
Expand Down

0 comments on commit 26242b1

Please sign in to comment.