Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loading components for the flux1-dev checkpoint Huggingface #153

Open
VTaPo opened this issue Sep 17, 2024 · 2 comments
Open

Loading components for the flux1-dev checkpoint Huggingface #153

VTaPo opened this issue Sep 17, 2024 · 2 comments

Comments

@VTaPo
Copy link

VTaPo commented Sep 17, 2024

I cannot loading components for the flux1-dev checkpoint.

Here is my code:
pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.enable_model_cpu_offload()
pipe.to(torch.float16)
prompt = "Create a commercial poster for restaurant"
out = pipe(
prompt=prompt,
guidance_scale=3.5,
height=768,
width=768,
num_inference_steps=1,
).images[0]
out.save("image.png")

The process always stops when 20% loading.
I have 40GB CPU RAM and 24GB VRAM on RTX3090.

@everythoughthelps
Copy link

pip install accelerate

@VTaPo
Copy link
Author

VTaPo commented Sep 19, 2024

@everythoughthelps Of course I did. However, every time I run the code as I provided, the loading components always stops at 20%. Is it possible that my configuration is not enough for using Flux1-dev from diffusers.

My requirements.txt file:
torch
torchvision

tokenizers
transformers
diffusers
accelerate
sentencepiece
bitsandbytes

numpy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants