Requirements

[kokofixcomputers]

What is the storage requirements and cpu and ram to run the whole thing including the python modules?

[mitya52]

First of all server needs GPU, no models now available on CPU (for now).
Storage depends on models you need to use.
What are your minimal hardware setup for server? And do you need finetune on your codebase?

[Meettya]

I suppose we are need minimal VRAM requirements for start as-is and for finetune cases. Is 8Gb cards enough for this model?

[mitya52]

if you want to finetune model (only 3b is available for now, but we are working on finetune for other models), minimal setup is 12Gb vram but we recommend to use GPU with 24Gb