Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sd3.5_medium-Q8_0.gguf Crash after execution #1230

Open
windkwbs opened this issue Nov 20, 2024 · 6 comments
Open

sd3.5_medium-Q8_0.gguf Crash after execution #1230

windkwbs opened this issue Nov 20, 2024 · 6 comments

Comments

@windkwbs
Copy link

sd3.5_medium-Q8_0.gguf
Crash after execution
koboldcpp_cu12-1.78.exe
微信截图_20241120123222

@LostRuins
Copy link
Owner

Stable Diffusion 3.5 models have many components.
You need to download and load a Clip-L, Clip-G and T5-XXL encoder as well (and maybe VAE)

Grab them all here: https://huggingface.co/Comfy-Org/stable-diffusion-3.5-fp8/tree/main/text_encoders
Then load them into the respective files below

@windkwbs
Copy link
Author

Stable Diffusion 3.5 models have many components. You need to download and load a Clip-L, Clip-G and T5-XXL encoder as well (and maybe VAE)

Grab them all here: https://huggingface.co/Comfy-Org/stable-diffusion-3.5-fp8/tree/main/text_encoders Then load them into the respective files below

Inference is slow, maybe some stuff is in cpu and not all in GPU

@LostRuins
Copy link
Owner

What GPU do you have? Did you select the Cublas option when loading?

@windkwbs
Copy link
Author

What GPU do you have? Did you select the Cublas option when loading?

微信截图_20241121002712
why?

@windkwbs
Copy link
Author

windkwbs commented Nov 20, 2024

微信截图_20241121003750

@LostRuins
Copy link
Owner

Okay maybe that gguf is defective.
Try this, just load the all-in-one model https://huggingface.co/Comfy-Org/stable-diffusion-3.5-fp8/resolve/main/sd3.5_medium_incl_clips_t5xxlfp8scaled.safetensors

Don't need to select anything else.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants