Code

Support speculate decoding#2541

Code

Merged

Jiang-Jia-Jun merged 13 commits intoPaddlePaddle:developPaddlePaddle/FastDeploy:developfrom Wanglongzhi2001:speculate_decodingWanglongzhi2001/FastDeploy:speculate_decodingCopy head branch name to clipboardJan 10, 2025

+144-43

Commits

Commits on Jan 9, 2025

• add speculate_decoding framework

  Wanglongzhi2001

  committed
  47aacb5

  Copy full SHA for 47aacb5

• v1.0 align accuracy

  Wanglongzhi2001

  committed
  e52155f

  Copy full SHA for e52155f

• remove debug log

  Wanglongzhi2001

  committed
  d5b6499

  Copy full SHA for d5b6499

• remove debug log

  Wanglongzhi2001

  committed
  389015b

  Copy full SHA for 389015b

• refactor code

  Wanglongzhi2001

  committed
  08877a9

  Copy full SHA for 08877a9

• fix typo

  Wanglongzhi2001

  committed
  e3bc5aa

  Copy full SHA for e3bc5aa

• import proposer from nlp

  Wanglongzhi2001

  committed
  ce3c09d

  Copy full SHA for ce3c09d

• update

  Wanglongzhi2001

  committed
  934e8d8

  Copy full SHA for 934e8d8

• fix typo

  Wanglongzhi2001

  committed
  ae57a2b

  Copy full SHA for ae57a2b

• update

  Wanglongzhi2001

  committed
  5c42585

  Copy full SHA for 5c42585

• fix typo

  Wanglongzhi2001

  committed
  ed5f65a

  Copy full SHA for ed5f65a

• update

  Wanglongzhi2001

  committed
  99d0921

  Copy full SHA for 99d0921

Commits on Jan 10, 2025

• update version of info_dict

  Wanglongzhi2001

  committed
  fe35dc5

  Copy full SHA for fe35dc5