Code

Chunked Prefill#656

Code

Draft

hlahkar wants to merge 3 commits intohabana_mainHabanaAI/vllm-fork:habana_mainfrom dev/hlahkar/test_chunked_prefillHabanaAI/vllm-fork:dev/hlahkar/test_chunked_prefillCopy head branch name to clipboard

+198-80

Commits

Commits on Dec 20, 2024

• Initial Commit Chunked Prefill

  hlahkar

  committed
  af4b0ad

Commits on Dec 30, 2024

• All Prefill passes fixed

  hlahkar

  committed
  418f477

Commits on Dec 31, 2024

• Update metadata for mixed batch

  hlahkar

  committed
  bfba0d1