Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does the node package support Qwen 2.5? #150

Open
Shyryp opened this issue Feb 2, 2025 · 1 comment
Open

Does the node package support Qwen 2.5? #150

Shyryp opened this issue Feb 2, 2025 · 1 comment

Comments

@Shyryp
Copy link

Shyryp commented Feb 2, 2025

Does the node package support Qwen 2.5?

I don't see any mentions in the repository of Qwen 2.5 or DeepSeek-R1-Distill-Qwen (deepseek-r1-qwen)

@heshengtao
Copy link
Owner

If your model is in the form of a folder, use the llm local loader; if it's in gguf format, then employ the llm gguf loader. I reckon if Qwen2 can be loaded, then as long as their team doesn't alter the interface, Qwen2.5 should be compatible as well. I haven't tested it yet though—there are just too many models to get through, hahaha.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants