Code

gptq_benchmark_update#1420

Code

Merged

SunMarc merged 25 commits intohuggingface:mainhuggingface/optimum:mainfrom SunMarc:update-benchmark-gptqSunMarc/optimum:update-benchmark-gptqCopy head branch name to clipboardNov 1, 2023

+211-139

Commits

Commits on Sep 27, 2023

• add_exllamav2

  SunMarc

  committed
  5db2541

  Copy full SHA for 5db2541

• style

  SunMarc

  committed
  03441b8

  Copy full SHA for 03441b8

• fix doc

  SunMarc

  committed
  80d085e

  Copy full SHA for 80d085e

• simplify script

  SunMarc

  committed
  0c53c2f

  Copy full SHA for 0c53c2f

• style

  SunMarc

  committed
  216213e

  Copy full SHA for 216213e

• Merge branch 'add_exllamav2' into update-benchmark-gptq

  SunMarc

  committed
  f2dbdc2

  Copy full SHA for f2dbdc2

• update perplexity measure

  SunMarc

  committed
  dadc6dc

  Copy full SHA for dadc6dc

• Revert "Merge branch 'add_exllamav2' into update-benchmark-gptq"

  Show description for cf4019d
  SunMarc

  committed
  cf4019d

  Copy full SHA for cf4019d

• Merge branch 'add_exllamav2' into update-benchmark-gptq

  SunMarc

  committed
  97a7c62

  Copy full SHA for 97a7c62

Commits on Sep 28, 2023

• fix arg in llama attention

  SunMarc

  committed
  62b89d9

  Copy full SHA for 62b89d9

Commits on Sep 29, 2023

• flash_attention arg

  SunMarc

  committed
  1ef6ce5

  Copy full SHA for 1ef6ce5

• Revert "Merge branch 'add_exllamav2' into update-benchmark-gptq"

  Show description for f727313
  SunMarc

  committed
  f727313

  Copy full SHA for f727313

• update benchmark prefill and generate

  SunMarc

  committed
  1eaedeb

  Copy full SHA for 1eaedeb

Commits on Oct 24, 2023

• Merge branch 'main' into update-benchmark-gptq

  SunMarc

  committed
  27a1ca1

  Copy full SHA for 27a1ca1

• replace by use_exllama_v2

  SunMarc

  committed
  a623556

  Copy full SHA for a623556

Commits on Oct 27, 2023

• update benchmark arg

  SunMarc

  committed
  26d87e4

  Copy full SHA for 26d87e4

Commits on Nov 1, 2023

• switch to a config_dict instead of disable_exllamav2

  SunMarc

  committed
  4f797b1

  Copy full SHA for 4f797b1

• Merge remote-tracking branch 'upstream/main' into better_config_for_exllama

  SunMarc

  committed
  a89f0a3

  Copy full SHA for a89f0a3

• Apply suggestions from code review

  Show description for 1d845c7
  

  SunMarc

  and

  fxmarty

  authored
  1d845c7

  Copy full SHA for 1d845c7

• better tests

  SunMarc

  committed
  d5b298f

  Copy full SHA for d5b298f

• Merge remote-tracking branch 'origin/better_config_for_exllama' into better_config_for_exllama

  SunMarc

  committed
  0694835

  Copy full SHA for 0694835

• style

  SunMarc

  committed
  c21601d

  Copy full SHA for c21601d

• Merge branch 'better_config_for_exllama' into update-benchmark-gptq

  SunMarc

  committed
  1c8c9e1

  Copy full SHA for 1c8c9e1

• style

  SunMarc

  committed
  11e71e2

  Copy full SHA for 11e71e2

• Merge remote-tracking branch 'upstream/main' into update-benchmark-gptq

  SunMarc

  committed
  71c2235

  Copy full SHA for 71c2235