MLX in Production? #870
justinh-rahb
started this conversation in
Show and tell
MLX in Production?
#870
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Yes.. you read that right. It can be done:
Screen.Recording.2024-06-30.at.10.21.59.AM.mp4
It even supports tool-use/function-calling:
Screen.Recording.2024-07-04.at.5.33.00.PM.mp4
All made possible by this "Pipeline" connector I've made, in combination with the Open WebUI project.
https://github.com/open-webui/pipelines/blob/main/examples/pipelines/providers/mlx_manifold_pipeline.py
Beta Was this translation helpful? Give feedback.
All reactions