Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate black forest labs FLUX.1 models into Galaxy #1496

Merged
merged 21 commits into from
Oct 14, 2024

Conversation

arash77
Copy link
Contributor

@arash77 arash77 commented Sep 4, 2024

Adding black forest labs FLUX.1 into Galaxy tools

@arash77 arash77 marked this pull request as ready for review September 9, 2024 13:58
@arash77
Copy link
Contributor Author

arash77 commented Sep 9, 2024

@bgruening What would be the best for the tests?

#folder you have stored. For example:
#
#black-forest-labs/FLUX.1-dev FLUX.1 [dev] is an open-weight, guidance-distilled model for non-commercial applications. /path/to/huggingface/that-contains/hub/models--black-forest-labs--FLUX.1-dev
#black-forest-labs/FLUX.1-schnell FLUX.1 [schnell] is the fastest model, tailored for personal use. /path/to/huggingface/that-contains/hub/models--black-forest-labs--FLUX.1-schnell
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we would need some more columns here, proposal:

  • pipeline_tag (see this URL: https://huggingface.co/models?pipeline_tag=text-to-image they call it that way)
  • domain (defined by the Galaxy community, e.g. image / sequence / text)
  • free_tag (not idea yet, but could be freely used by an admin to specify more filter options)
  • version (if available)

Have just talked with @anuprulez about this, he would like to use the same data table ... lets talk about this in the next days.

@arash77
Copy link
Contributor Author

arash77 commented Sep 12, 2024

It looks likes that if the dev model already exists it doesn't require the access token anymore!

#Your huggingface.loc file should include the huggingface cached model
#folder you have stored. For example:
#
#black-forest-labs/FLUX.1-dev FLUX.1 [dev] is an open-weight, guidance-distilled model for non-commercial applications. text-to-image image flux 1 /path/to/huggingface/that-contains/hub/models--black-forest-labs--FLUX.1-dev
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@beatrizserrano @anuprulez @kostrykin maybe you are interested in this.

We are trying to come up with a potential Galax data table for huggingface. So that Galaxy instance admin can download models deposit them locally and register them in such data tables.

Different tools can then depend on that table and filter them according to a tiny bit of metadata.

#domain (defined by the Galaxy community, e.g. image / sequence / text)
#free_tag (not idea yet, but could be freely used by an admin to specify more filter options)
#version (if available)
#Your huggingface.loc file should include the huggingface cached model folder you have stored.
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does it really need to contain path to the folder or the path to the model/file?

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks more like the file.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It should be the folder of HF_HOME

@bgruening bgruening merged commit 71b3dac into bgruening:master Oct 14, 2024
11 checks passed
@bgruening
Copy link
Owner

Thanks Arash!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants