Code

More quantize support#176

Code

Open

YixinSong-e wants to merge 13 commits intomainSJTU-IPADS/PowerInfer:mainfrom quantize-supportSJTU-IPADS/PowerInfer:quantize-supportCopy head branch name to clipboard

+1,095-88

Commits

Commits on Mar 31, 2024

• support q8 sparse operator for CPU

  

  syx

  committed
  be58c2b

• add avx2 for q8

  

  syx

  committed
  6d83a8b

• support q8

  

  syx

  committed
  b5c8c08

• support q4_1 in cpu scalar

  

  syx

  committed
  ce5464d

• minor

  

  syx

  committed
  d7c074e

• support q4_1

  

  syx

  committed
  450d36f

• support q5_0 for cpu

  

  syx

  committed
  1848cc2

• q5 support

  

  syx

  committed
  86f6661

• q5_1 support

  

  syx

  committed
  0c66508

• q5_1 support

  

  syx

  committed
  7a04b46

• minor

  

  syx

  committed
  e2b668d

• minor

  

  syx

  committed
  e1002f6

• fix syntax error

  hodlen

  committed
  4f12696