Code

Feat: support for optimum#826

Code

Merged

Giuseppe5 merged 20 commits intodevXilinx/brevitas:devfrom optimumXilinx/brevitas:optimumCopy head branch name to clipboardFeb 6, 2024

+599-539

Commits

Commits on Feb 6, 2024

• optimum: initial optimum integration

  

  nickfraser

  authored and

  Giuseppe5

  committed
  35785ea

• Refined solution for offloading

  Giuseppe5

  committed
  faebbb5

• Fix (optimum): clean-up (#802)

  Giuseppe5

  committed
  023fa1e

• Fix (optimum): dataloader and forward cleanup (#807)

  Giuseppe5

  committed
  1365772

• Fix (optimum): forward pass + fx (#808)

  Giuseppe5

  committed
  beaffa9

• FX forward, GPTQ, Export (#809)

  Show description for 95ac67a
  Giuseppe5

  committed
  95ac67a

• Fix 2GB ONNX export error

  Giuseppe5

  committed
  c6cf2a7

• Fix gptq + speedup

  Giuseppe5

  committed
  8e973f8

• Feat (offload/fx): better buffer/params + call_functional (#816)

  Giuseppe5

  committed
  38dc8b3

• Fix: typo to setting weight handlers

  

  nickfraser

  authored and

  Giuseppe5

  committed
  158b573

• Feat (optimum): better call_function FX offload (#817)

  Giuseppe5

  committed
  4e49db1

• Refactored per row quantization. JIT not working (#818)

  Giuseppe5

  committed
  f0236c9

• Better structure for QDQ weights (#822)

  Giuseppe5

  committed
  5eaa5b4

• Fix (export): flag for torch qcdq export (#823)

  Giuseppe5

  committed
  43a1ec8

• Setup: remove optimum folder (#825)

  Giuseppe5

  committed
  a653be0

• Add/fix comments

  Giuseppe5

  committed
  e01f0d1

• Fix llm example

  Giuseppe5

  committed
  acf95e3

• Misc: pre-commit fix

  Giuseppe5

  committed
  c9f28d7

• Fix (graph/equalize): new transpose interface

  Giuseppe5

  committed
  3f8e41a

• Fix (examples/llm): no constant folding for group quant

  Giuseppe5

  committed
  6c79063