SD3 and Flux support

[IlyasMoutawwakil]

What does this PR do?

In this PR we add support of SD3 and Flux Diffusion Pipelines, for onnx export and onnxruntime inference.

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

Who can review?

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[JingyaHuang]

LGTM as far as we get the CIs green. Thanks for adding the support @IlyasMoutawwakil !

[kahmed10]

How would this work with stabilityai/stable-diffusion-3-medium on huggingface?

Even after specifying the framework as pytorch, it's not able infer the correct library for the models:

optimum-cli export onnx --model stabilityai/stable-diffusion-3-medium --framework pt  models/sd3-onnx
  File "/home/kahmed10/.local/bin/optimum-cli", line 8, in <module>
    sys.exit(main())
  File "/home/kahmed10/.local/lib/python3.10/site-packages/optimum/commands/optimum_cli.py", line 208, in main
    service.run()
  File "/home/kahmed10/.local/lib/python3.10/site-packages/optimum/commands/export/onnx.py", line 265, in run
    main_export(
  File "/home/kahmed10/.local/lib/python3.10/site-packages/optimum/exporters/onnx/__main__.py", line 258, in main_export
    task = TasksManager.infer_task_from_model(model_name_or_path)
  File "/home/kahmed10/.local/lib/python3.10/site-packages/optimum/exporters/tasks.py", line 1764, in infer_task_from_model
    inferred_task_name = cls._infer_task_from_model_name_or_path(
  File "/home/kahmed10/.local/lib/python3.10/site-packages/optimum/exporters/tasks.py", line 1678, in _infer_task_from_model_name_or_path
    library_name = cls.infer_library_from_model(
  File "/home/kahmed10/.local/lib/python3.10/site-packages/optimum/exporters/tasks.py", line 1918, in infer_library_from_model
    library_name = cls._infer_library_from_model_name_or_path(
  File "/home/kahmed10/.local/lib/python3.10/site-packages/optimum/exporters/tasks.py", line 1880, in _infer_library_from_model_name_or_path
    raise ValueError(
ValueError: The library name could not be automatically inferred. If using the command-line, please provide the argument --library {transformers,diffusers,timm,sentence_transformers}. Example: `--library diffusers`.

[IlyasMoutawwakil]

hi @kahmed10, the pipeline should be loadable with diffusers first, stability has a diffusers-compatible pipeline in stabilityai/stable-diffusion-3-medium-diffusers

[kahmed10]

hi @kahmed10, the pipeline should be loadable with diffusers first, stability has a diffusers-compatible pipeline in stabilityai/stable-diffusion-3-medium-diffusers

This worked, thanks!!!

optimum-cli export onnx --model stabilityai/stable-diffusion-3-medium-diffusers  models/sd3-onnx

[kahmed10]

@IlyasMoutawwakil is this planning to be merged in soon? I see in CI there are some tests failing.

[IlyasMoutawwakil]

@kahmed10 it should be merged today, the failing tests are unrelated (because tests saturating the memory).

[IlyasMoutawwakil]

tests are passing except for macos-13 (due to known issue handled in #2085)

[echarlaix]

Looks great thanks @IlyasMoutawwakil

[IlyasMoutawwakil]

will merge once all ci is finished !

[IlyasMoutawwakil]

with the merged #2085, I added some checks based on transformers and diffusers versions.

[xhcao]

Hi, @IlyasMoutawwakil Did this patch support to export the series of SD3 to onnx models, include SD3.5 large, SD3.5 Large Turbo, SD3.5 Medium and SD3.0-medium?