Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GGML_ASSERT failed #1238

Open
sardior opened this issue Nov 25, 2024 · 2 comments
Open

GGML_ASSERT failed #1238

sardior opened this issue Nov 25, 2024 · 2 comments

Comments

@sardior
Copy link

sardior commented Nov 25, 2024

Currently I'm learning this tool, I'm probably just missing some settings but I don't know which one. While trying to set up image generation I ran into this problem.

Version: KoboldCpp - Version 1.78
OS: 6.6.54-2-MANJARO # 1 SMP PREEMPT_DYNAMI

I launch using:

./koboldcpp --usevulkan 0 --gpulayers 33 --contextsize 32768 \
			--model "$HOME/Games/koboldcpp/Meta-Llama-3.1-8B-Instruct-f32.gguf" \
			--sdmodel "$HOME/Games/koboldcpp/sd3.5_large_turbo.safetensors"

or just ./koboldcpp and configure the gui. Both cases end up with this failed assert.

ImageGen Init - Load Model: /home/slawo/Games/koboldcpp/sd3.5_large_turbo.safetensors
ggml/src/ggml.c:1568: GGML_ASSERT(type >= 0 && type < GGML_TYPE_COUNT) failed
/home/slawo/bin/koboldcpp: line 17: 163560 Aborted                 (core dumped) ./koboldcpp --usevulkan 0 --gpulayers 33 --contextsize 32768 --model "$HOME/Games/koboldcpp/Meta-Llama-3.1-8B-Instruct-f32.gguf" --sdmodel "$HOME/Games/koboldcpp/sd3.5_large_turbo.safetensors"

Is there a setting that corresponds to GGML_TYPE_COUNT ? I could not find anything in the wiki.

@LostRuins
Copy link
Owner

Could you link a download to this model so I can take a look

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants