You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We're running a project in the CivicLab in Grenoble, France. The project is based on LLM and is building as opensource project.
We're trying to build, test, prototype and evaluate an assistant for public consultation.
We're looking for CPT Framework and also the opportunity to make new partnerships or relationships for counselling.
At this stage I have only one 8 RAM GPU, so I'm using a mistral 7B quantized based model.
Soon I'll get access to an A5 family GPU (around 24 Go) thanks to a contributor.
So my question is: is your framework is compatible with quantized model and QLora? Is it model agnostic?
Also we're interesting by new contributor to help us make this prototype comes true. It'll be a pleasure to exchange about project with the OpenLLM-France. community
The text was updated successfully, but these errors were encountered:
Hi,
We're running a project in the CivicLab in Grenoble, France. The project is based on LLM and is building as opensource project.
We're trying to build, test, prototype and evaluate an assistant for public consultation.
We're looking for CPT Framework and also the opportunity to make new partnerships or relationships for counselling.
At this stage I have only one 8 RAM GPU, so I'm using a mistral 7B quantized based model.
Soon I'll get access to an A5 family GPU (around 24 Go) thanks to a contributor.
So my question is: is your framework is compatible with quantized model and QLora? Is it model agnostic?
Also we're interesting by new contributor to help us make this prototype comes true. It'll be a pleasure to exchange about project with the OpenLLM-France. community
The text was updated successfully, but these errors were encountered: