Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Download models #521

Open
project21212 opened this issue Mar 2, 2025 · 2 comments
Open

Download models #521

project21212 opened this issue Mar 2, 2025 · 2 comments

Comments

@project21212
Copy link

Hello,

I tried searching online for a 1.5B model (as I do not have enough computer resources) for ollama without success?
My computer currently runs under Linux.
Would you please be able to provide a link/page to download the open-source model.

Thank you,

@cx0222
Copy link

cx0222 commented Mar 2, 2025

The DeepSeek models are quite large and require substantial computing resources to run. However, you may consider using the distilled version (1.5B), which is more lightweight. You can find it here. Additionally, the link to the safetensors file is available at this page.

@cx0222
Copy link

cx0222 commented Mar 2, 2025

If you're using llama.cpp or Ollama on Linux, you can take advantage of the quantized model, which offers lower precision and a smaller size. You can find it here.

For guidance on using GGUF files with Ollama, please refer to the official documentation: Hugging Face Ollama Guide.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants