Code

Add Phi 3.5 MoE#116

Code

Merged

davidkoski merged 6 commits intoml-explore:mainml-explore/mlx-swift-examples:mainfrom DePasqualeOrg:phi-moeDePasqualeOrg/mlx-swift-examples:phi-moeCopy head branch name to clipboardOct 22, 2024

+479-27

Commits

Commits on Oct 22, 2024

• Add Phi 3.5 MoE

  

  DePasqualeOrg

  authored and

  davidkoski

  committed
  e6bdadb

  Copy full SHA for e6bdadb

• Address feedback

  

  DePasqualeOrg

  authored and

  davidkoski

  committed
  f692c71

  Copy full SHA for f692c71

• make sure all models are registered. fix prompt generation

  davidkoski

  committed
  732a485

  Copy full SHA for 732a485

• make SwitchLinear match how Linear work re: quantization

  davidkoski

  committed
  de4ee6e

  Copy full SHA for de4ee6e

• split switch layers into its own file (to better match the python version)

  davidkoski

  committed
  9e785c6

  Copy full SHA for 9e785c6

• test & fix commented lines -- was very close!

  davidkoski

  committed
  32cfffb

  Copy full SHA for 32cfffb