Code

Fixes for SGLang Benchmark Test#910

Code

Merged

stbaione merged 16 commits intomainnod-ai/shark-ai:mainfrom users/stbaione/sglang-benchmark-fixnod-ai/shark-ai:users/stbaione/sglang-benchmark-fixCopy head branch name to clipboardFeb 5, 2025

+160-141

Commits

Commits on Feb 4, 2025

• Add huggingface login step in shortfin benchmark,

  Show description for 2df7e28
  stbaione

  committed
  2df7e28

  Copy full SHA for 2df7e28

• Temporarily add pull_request trigger for CI validation

  stbaione

  committed
  e5d8fca

  Copy full SHA for e5d8fca

• Add installtion for sharktank/shortfin/iree

  stbaione

  committed
  eaa7840

  Copy full SHA for eaa7840

• Ensure container is always cleaned up

  stbaione

  committed
  4a5732d

  Copy full SHA for 4a5732d

• initial fix

  renxida

  committed
  fb60699

  Copy full SHA for fb60699

• import absolute rather than relative

  renxida

  committed
  46720d1

  Copy full SHA for 46720d1

• remove model_param_file_name

  renxida

  committed
  5c48275

  Copy full SHA for 5c48275

• Merge branch 'users/stbaione/sglang-benchmark-fix' of https://github.com/nod-ai/shark-ai into fix-sglang-benchmark-missing-models

  renxida

  committed
  4f53558

  Copy full SHA for 4f53558

• fix sglang benchmark test and see if we can proceed on shortfin benchmark test despite hf login failure

  renxida

  committed
  515072a

  Copy full SHA for 515072a

• Add missing cli field for sglang bench_serve

  stbaione

  committed
  7bcbed3

  Copy full SHA for 7bcbed3

• Add apply_chat_template namespace arg

  stbaione

  committed
  3a973c4

  Copy full SHA for 3a973c4

• Add field

  stbaione

  committed
  1f11196

  Copy full SHA for 1f11196

• Fix stopping server

  stbaione

  committed
  2349fa0

  Copy full SHA for 2349fa0

Commits on Feb 5, 2025

• Let conftest handle shutting down the server

  stbaione

  committed
  777f4b8

  Copy full SHA for 777f4b8

• Remove temporary pr trigger

  stbaione

  committed
  54e4720

  Copy full SHA for 54e4720

• Merge branch 'main' into users/stbaione/sglang-benchmark-fix

  stbaione

  authored
  2b4ccfc

  Copy full SHA for 2b4ccfc