Code

Add the Mixtral model.#1437

Code

Merged

LaurentMazare merged 13 commits intomainhuggingface/candle:mainfrom mixtralhuggingface/candle:mixtralCopy head branch name to clipboardDec 15, 2023

+788

Commits

Commits on Dec 14, 2023

• Add the Mixtral model.

  LaurentMazare

  committed
  a57a91e

  Copy full SHA for a57a91e

• Add more of the mixtral layers.

  LaurentMazare

  committed
  965bb16

  Copy full SHA for 965bb16

• Add the final layers for mixtral.

  LaurentMazare

  committed
  4dcdb2d

  Copy full SHA for 4dcdb2d

• Sketch the expert selection.

  LaurentMazare

  committed
  a6159d1

  Copy full SHA for a6159d1

Commits on Dec 15, 2023

• Add some expert routing logic.

  LaurentMazare

  committed
  1ff4c62

  Copy full SHA for 1ff4c62

• Hopefully finish the routing logic for mixtral.

  LaurentMazare

  committed
  944f2c7

  Copy full SHA for 944f2c7

• Add the mixtral example.

  LaurentMazare

  committed
  5442f77

  Copy full SHA for 5442f77

• Fix the weight filenames.

  LaurentMazare

  committed
  74f3dbb

  Copy full SHA for 74f3dbb

• Bugfix.

  LaurentMazare

  committed
  9175dcc

  Copy full SHA for 9175dcc

• Another fix.

  LaurentMazare

  committed
  8ba6cdb

  Copy full SHA for 8ba6cdb

• Yet another fix + remove the unused pragma.

  LaurentMazare

  committed
  74fc82c

  Copy full SHA for 74fc82c

• Shape fix.

  LaurentMazare

  committed
  5471437

  Copy full SHA for 5471437

• Add a readme.

  LaurentMazare

  committed
  3c9db2a

  Copy full SHA for 3c9db2a