Code

[Model] Add Llama-SwiftKV model#11023

Code

Open

aurickq wants to merge 14 commits intovllm-project:mainvllm-project/vllm:mainfrom Snowflake-Labs:swiftkvSnowflake-Labs/vllm-:swiftkvCopy head branch name to clipboard

+1,191-6

Commits

Commits on Dec 3, 2024

• implement llama-swiftkv

  sfc-gh-aqiao

  committed
  052f527

• cuda graph config

  sfc-gh-aqiao

  committed
  e01dcce

Commits on Dec 4, 2024

• Create README.md

  sfc-gh-jrasley

  authored
  9087a77

• swiftkv readme

  sfc-gh-jrasley

  authored
  21eaea8

Commits on Dec 5, 2024

• update swiftkv examples

  sfc-gh-aqiao

  committed
  31f8eb7

• fix cuda graph

  sfc-gh-aqiao

  committed
  9c36e31

• Update README.md

  sfc-gh-aqiao

  authored
  4f3d05a

Commits on Dec 7, 2024

• add test and fix a few bugs

  aurickq

  committed
  bb43a8b

• Merge branch 'main' into swiftkv

  aurickq

  committed
  c454ebb

Commits on Dec 9, 2024

• Merge branch 'vllm-project:main' into swiftkv

  aurickq

  authored
  16d45f2

• lint

  aurickq

  committed
  95a264d

• lint

  aurickq

  committed
  a68890a

• lint

  aurickq

  committed
  eac1d45

• Update README.md

  aurickq

  authored
  e7cbfc4