Code

Multi round dialogue branch#5772

Code

Draft

isky-cd wants to merge 4 commits intohpcaitech:mainhpcaitech/ColossalAI:mainfrom isky-cd:multi_round_dialogue_branchisky-cd/ColossalAI:multi_round_dialogue_branchCopy head branch name to clipboard

+842-143

Commits

Commits on May 22, 2024

• Add Streaming LLM

  isky-cd

  committed
  829ccc2

Commits on May 23, 2024

• add some parameters to llama_generation.py

  isky-cd

  committed
  c3f4edb

• verify streamingllm config

  isky-cd

  committed
  d63e068

Commits on Jun 3, 2024

• add prefix flash attn

  isky-cd

  committed
  beddf23