Code

[V1] Prefix caching#9668

Code

Closed

comaniac wants to merge 12 commits intovllm-project:mainvllm-project/vllm:mainfrom comaniac:v1_prefix_cachingcomaniac/vllm:v1_prefix_cachingCopy head branch name to clipboard

+709-43

Commits

Commits on Oct 28, 2024

• wip

  Show description for c2a67b2
  comaniac

  committed
  c2a67b2

  Copy full SHA for c2a67b2

• wip

  Show description for 5d92def
  comaniac

  committed
  5d92def

  Copy full SHA for 5d92def

• work

  Show description for 9886e84
  comaniac

  committed
  9886e84

  Copy full SHA for 9886e84

• fix

  Show description for 15dd26b
  comaniac

  committed
  15dd26b

  Copy full SHA for 15dd26b

• fix

  Show description for d298e65
  comaniac

  committed
  d298e65

  Copy full SHA for d298e65

• refactor

  Show description for 7d71cdb
  comaniac

  committed
  7d71cdb

  Copy full SHA for 7d71cdb

• async

  Show description for f5e18ea
  comaniac

  committed
  f5e18ea

  Copy full SHA for f5e18ea

• fix

  Show description for 4e2b4bf
  comaniac

  committed
  4e2b4bf

  Copy full SHA for 4e2b4bf

• format

  Show description for 1735f4f
  comaniac

  committed
  1735f4f

  Copy full SHA for 1735f4f

• test

  Show description for 6b87953
  comaniac

  committed
  6b87953

  Copy full SHA for 6b87953

• fix example

  Show description for 632fd92
  comaniac

  committed
  632fd92

  Copy full SHA for 632fd92

Commits on Nov 1, 2024

• fix allocation est

  Show description for 499bd7e
  comaniac

  committed
  499bd7e

  Copy full SHA for 499bd7e