Building an simple Generative AI application to run text inference on Mixtral 8x7B running on Modal's Serverless Platform.
-
Notifications
You must be signed in to change notification settings - Fork 0
Generative AI application to run text generation inference (TGI) on Mixtral_8x7B running on Modal's Serverless Platform.
License
100stacks/fastapi-mixtral-text-generation-inference
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Generative AI application to run text generation inference (TGI) on Mixtral_8x7B running on Modal's Serverless Platform.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published