Code

[Misc] Small perf improvements#6520

Code

Merged

simon-mo merged 14 commits intomainvllm-project/vllm:mainfrom small_improvementsvllm-project/vllm:small_improvementsCopy head branch name to clipboardJul 19, 2024

+46-23

Commits

Commits on Jul 17, 2024

• Cache importlib in ModelRegistry

  Yard1

  authored
  c5e350b

• Fast return for get_common_computed_block_ids

  Yard1

  authored
  f269738

• chunk_list into an iterator

  Yard1

  authored
  a36da80

• Cache _first_seq in SequenceGroup

  Yard1

  authored
  47ce44f

• Lint

  Yard1

  authored
  69d73a3

• Lint

  Yard1

  authored
  bbef0e1

• Lint

  Yard1

  authored
  34c30df

• Fix test

  Yard1

  authored
  6b45138

• Fix

  Yard1

  authored
  f27f653

• Lint

  Yard1

  authored
  31e4c76

• Fix

  Yard1

  authored
  dd897db

Commits on Jul 18, 2024

• Fix

  Yard1

  committed
  ebf4794

• Merge branch 'upstream_main' into small_improvements

  Yard1

  committed
  5eddc37

Commits on Jul 19, 2024

• Merge branch 'upstream_main' into small_improvements

  Yard1

  committed
  e39f05c