Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bump diffusers version (and accelerate, hugginface-hub) #7174

Merged
merged 6 commits into from
Oct 28, 2024
Merged

Bump diffusers version (and accelerate, hugginface-hub) #7174

merged 6 commits into from
Oct 28, 2024

Conversation

RyanJDick
Copy link
Collaborator

@RyanJDick RyanJDick commented Oct 23, 2024 •
edited
Loading

Summary

Bump diffusers and its dependencies.

The main motivation for bumping now is for access to the latest SD3 code.

QA Instructions

I smoke tested the follwing on CUDA:

  • SD1, SDXL and FLUX text-to-image
  • ControlNet
  • IP-Adapter
  • Regional prompting
  • LoRA
  • Main model installation

Remaining tests:

  • Running on CPU
  • Running on MacOS
  • xformers
  • Installation of a variety of model types

Merge Plan

No special instructions.

Checklist

  • The PR has a short but descriptive title, suitable for a changelog
  • Tests added / updated (if applicable) N/A
  • Documentation added / updated (if applicable) N/A

@github-actions github-actions bot added python PRs that change python files Root backend PRs that change backend files python-deps PRs that change python dependencies labels Oct 23, 2024
@ebr
Copy link
Member

ebr commented Oct 23, 2024 •
edited
Loading

Error with the DEIS scheduler on SD1.5 I got this once and was unable to reproduce it again - leaving here anyway for the record


Traceback (most recent call last):
  File "/opt/invokeai/invokeai/app/services/session_processor/session_processor_default.py", line 129, in run_node
    output = invocation.invoke_internal(context=context, services=self._services)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/invokeai/invokeai/app/invocations/baseinvocation.py", line 290, in invoke_internal
    output = self.invoke(context)
             ^^^^^^^^^^^^^^^^^^^^
  File "/opt/invokeai/invokeai/app/invocations/denoise_latents.py", line 792, in invoke
    return self._old_invoke(context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/invokeai/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/contextlib.py", line 81, in inner
    return func(*args, **kwds)
           ^^^^^^^^^^^^^^^^^^^
  File "/opt/invokeai/invokeai/app/invocations/denoise_latents.py", line 1001, in _old_invoke
    scheduler = get_scheduler(
                ^^^^^^^^^^^^^^
  File "/opt/invokeai/invokeai/app/invocations/denoise_latents.py", line 106, in get_scheduler
    scheduler = scheduler_class.from_config(scheduler_config)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/invokeai/lib/python3.11/site-packages/diffusers/configuration_utils.py", line 260, in from_config
    model = cls(**init_dict)
            ^^^^^^^^^^^^^^^^
  File "/opt/venv/invokeai/lib/python3.11/site-packages/diffusers/configuration_utils.py", line 665, in inner_init
    init(self, *args, **init_kwargs)
  File "/opt/venv/invokeai/lib/python3.11/site-packages/diffusers/schedulers/scheduling_dpmsolver_multistep.py", line 285, in __init__
    raise ValueError(
ValueError: `final_sigmas_type` zero is not supported for `algorithm_type` deis. Please choose `sigma_min` instead.

Graph:

{
    "item_id": 1, 
    "status": "failed", 
    "priority": 0, 
    "batch_id": "dc4e105f-50ca-48c3-b7db-89dd999bf157", 
    "origin": "canvas", 
    "destination": "gallery", 
    "session_id": "8d609d61-f85f-4ce5-b6bb-2da809da5873", 
    "error_type": "ValueError", 
    "error_message": "`final_sigmas_type` zero is not supported for `algorithm_type` deis. Please choose `sigma_min` instead.", 
    "error_traceback": "Traceback (most recent call last):\n  File \"/opt/invokeai/invokeai/app/services/session_processor/session_processor_default.py\", line 129, in run_node\n    output = invocation.invoke_internal(context=context, services=self._services)\n             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/opt/invokeai/invokeai/app/invocations/baseinvocation.py\", line 290, in invoke_internal\n    output = self.invoke(context)\n             ^^^^^^^^^^^^^^^^^^^^\n  File \"/opt/invokeai/invokeai/app/invocations/denoise_latents.py\", line 792, in invoke\n    return self._old_invoke(context)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/opt/venv/invokeai/lib/python3.11/site-packages/torch/utils/_contextlib.py\", line 116, in decorate_context\n    return func(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/lib/python3.11/contextlib.py\", line 81, in inner\n    return func(*args, **kwds)\n           ^^^^^^^^^^^^^^^^^^^\n  File \"/opt/invokeai/invokeai/app/invocations/denoise_latents.py\", line 1001, in _old_invoke\n    scheduler = get_scheduler(\n                ^^^^^^^^^^^^^^\n  File \"/opt/invokeai/invokeai/app/invocations/denoise_latents.py\", line 106, in get_scheduler\n    scheduler = scheduler_class.from_config(scheduler_config)\n                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/opt/venv/invokeai/lib/python3.11/site-packages/diffusers/configuration_utils.py\", line 260, in from_config\n    model = cls(**init_dict)\n            ^^^^^^^^^^^^^^^^\n  File \"/opt/venv/invokeai/lib/python3.11/site-packages/diffusers/configuration_utils.py\", line 665, in inner_init\n    init(self, *args, **init_kwargs)\n  File \"/opt/venv/invokeai/lib/python3.11/site-packages/diffusers/schedulers/scheduling_dpmsolver_multistep.py\", line 285, in __init__\n    raise ValueError(\nValueError: `final_sigmas_type` zero is not supported for `algorithm_type` deis. Please choose `sigma_min` instead.\n", 
    "created_at": "2024-10-23 19:58:26.661", 
    "updated_at": "2024-10-23 19:58:42.147", 
    "started_at": "2024-10-23 19:58:26.798", 
    "completed_at": "2024-10-23 19:58:42.133", 
    "queue_id": "default", 
    "field_values": [
        {"node_path": "noise:RTSeTpWDuo"        , "field_name": "seed"           , "value": 4222824524}, 
        {"node_path": "core_metadata:eAruYq1gyS", "field_name": "seed"           , "value": 4222824524}, 
        {"node_path": "pos_cond:GPoNbVWrLo"     , "field_name": "prompt"         , "value": ""        }, 
        {"node_path": "core_metadata:eAruYq1gyS", "field_name": "positive_prompt", "value": ""        }  
    ], 
    "session": {
        "id": "8d609d61-f85f-4ce5-b6bb-2da809da5873", 
        "graph": {
            "id": "sd1_graph:JwcfpbDGmg", 
            "nodes": {
                "sd1_model_loader:Zadf4O52nz": {
                    "id": "sd1_model_loader:Zadf4O52nz", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "model": {
                        "key" : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash": "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name": "Dreamshaper 8"                                                          , 
                        "base": "sd-1"                                                                   , 
                        "type": "main"                                                                     
                    }, 
                    "type": "main_model_loader"
                }, 
                "clip_skip:mMUIMHyX96": {
                    "id": "clip_skip:mMUIMHyX96", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "skipped_layers": 0, 
                    "type": "clip_skip"
                }, 
                "pos_cond:GPoNbVWrLo": {
                    "id": "pos_cond:GPoNbVWrLo", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "prompt": "", 
                    "type": "compel"
                }, 
                "pos_cond_collect:cqfOJITWfj": {
                    "id": "pos_cond_collect:cqfOJITWfj", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "collection": [], 
                    "type": "collect"
                }, 
                "neg_cond:UMywrXsVT3": {
                    "id": "neg_cond:UMywrXsVT3", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "prompt": "", 
                    "type": "compel"
                }, 
                "neg_cond_collect:QAIPSKKNWH": {
                    "id": "neg_cond_collect:QAIPSKKNWH", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "collection": [], 
                    "type": "collect"
                }, 
                "noise:RTSeTpWDuo": {
                    "id": "noise:RTSeTpWDuo", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "seed": 4222824524, 
                    "width": 512, 
                    "height": 512, 
                    "use_cpu": true, 
                    "type": "noise"
                }, 
                "denoise_latents:z2BRuJsm9K": {
                    "id": "denoise_latents:z2BRuJsm9K", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "steps": 30, 
                    "cfg_scale": 7.5, 
                    "denoising_start": 0, 
                    "denoising_end": 1, 
                    "scheduler": "dpmpp_3m_k", 
                    "cfg_rescale_multiplier": 0, 
                    "type": "denoise_latents"
                }, 
                "core_metadata:eAruYq1gyS": {
                    "id": "core_metadata:eAruYq1gyS", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "generation_mode": "txt2img", 
                    "positive_prompt": "", 
                    "negative_prompt": "", 
                    "width": 512, 
                    "height": 512, 
                    "seed": 4222824524, 
                    "rand_device": "cpu", 
                    "cfg_scale": 7.5, 
                    "cfg_rescale_multiplier": 0, 
                    "steps": 30, 
                    "scheduler": "dpmpp_3m_k", 
                    "clip_skip": 0, 
                    "model": {
                        "key" : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash": "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name": "Dreamshaper 8"                                                          , 
                        "base": "sd-1"                                                                   , 
                        "type": "main"                                                                     
                    }, 
                    "type": "core_metadata", 
                    "regions": [], 
                    "canvas_v2_metadata": {
                        "referenceImages": [], 
                        "controlLayers": [], 
                        "inpaintMasks": [
                            {
                                "id": "inpaint_mask:sstGjgUSek", 
                                "name": null, 
                                "type": "inpaint_mask", 
                                "isEnabled": true, 
                                "isLocked": false, 
                                "objects": [], 
                                "opacity": 1, 
                                "position": {"x": 0, "y": 0}, 
                                "fill": { "style": "diagonal", "color": {"r": 224, "g": 117, "b": 117} }
                            }
                        ], 
                        "rasterLayers": [], 
                        "regionalGuidance": []
                    }
                }, 
                "canvas_output:Q5turAM3MX": {
                    "id": "canvas_output:Q5turAM3MX", 
                    "is_intermediate": false, 
                    "use_cache": false, 
                    "tiled": false, 
                    "tile_size": 0, 
                    "fp32": true, 
                    "type": "l2i"
                }
            }, 
            "edges": [
                {
                    "source"     : {"node_id": "sd1_model_loader:Zadf4O52nz", "field": "unet"}, 
                    "destination": {"node_id": "denoise_latents:z2BRuJsm9K" , "field": "unet"}  
                }, 
                {
                    "source"     : {"node_id": "sd1_model_loader:Zadf4O52nz", "field": "clip"}, 
                    "destination": {"node_id": "clip_skip:mMUIMHyX96"       , "field": "clip"}  
                }, 
                {
                    "source"     : {"node_id": "clip_skip:mMUIMHyX96", "field": "clip"}, 
                    "destination": {"node_id": "pos_cond:GPoNbVWrLo" , "field": "clip"}  
                }, 
                {
                    "source"     : {"node_id": "clip_skip:mMUIMHyX96", "field": "clip"}, 
                    "destination": {"node_id": "neg_cond:UMywrXsVT3" , "field": "clip"}  
                }, 
                {
                    "source"     : {"node_id": "pos_cond:GPoNbVWrLo"        , "field": "conditioning"}, 
                    "destination": {"node_id": "pos_cond_collect:cqfOJITWfj", "field": "item"        }  
                }, 
                {
                    "source"     : {"node_id": "neg_cond:UMywrXsVT3"        , "field": "conditioning"}, 
                    "destination": {"node_id": "neg_cond_collect:QAIPSKKNWH", "field": "item"        }  
                }, 
                {
                    "source"     : {"node_id": "pos_cond_collect:cqfOJITWfj", "field": "collection"           }, 
                    "destination": {"node_id": "denoise_latents:z2BRuJsm9K" , "field": "positive_conditioning"}  
                }, 
                {
                    "source"     : {"node_id": "neg_cond_collect:QAIPSKKNWH", "field": "collection"           }, 
                    "destination": {"node_id": "denoise_latents:z2BRuJsm9K" , "field": "negative_conditioning"}  
                }, 
                {
                    "source"     : {"node_id": "noise:RTSeTpWDuo"          , "field": "noise"}, 
                    "destination": {"node_id": "denoise_latents:z2BRuJsm9K", "field": "noise"}  
                }, 
                {
                    "source"     : {"node_id": "denoise_latents:z2BRuJsm9K", "field": "latents"}, 
                    "destination": {"node_id": "canvas_output:Q5turAM3MX"  , "field": "latents"}  
                }, 
                {
                    "source"     : {"node_id": "sd1_model_loader:Zadf4O52nz", "field": "vae"}, 
                    "destination": {"node_id": "canvas_output:Q5turAM3MX"   , "field": "vae"}  
                }, 
                {
                    "source"     : {"node_id": "core_metadata:eAruYq1gyS", "field": "metadata"}, 
                    "destination": {"node_id": "canvas_output:Q5turAM3MX", "field": "metadata"}  
                }
            ]
        }, 
        "execution_graph": {
            "id": "3784d010-db9c-4c15-851a-2d430df9e979", 
            "nodes": {
                "c2ee0957-6f0e-41f9-afaf-16c7d6c74051": {
                    "id": "c2ee0957-6f0e-41f9-afaf-16c7d6c74051", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "model": {
                        "key" : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash": "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name": "Dreamshaper 8"                                                          , 
                        "base": "sd-1"                                                                   , 
                        "type": "main"                                                                     
                    }, 
                    "type": "main_model_loader"
                }, 
                "a67d6405-af2f-42e0-aebd-04e2e3348a9c": {
                    "id": "a67d6405-af2f-42e0-aebd-04e2e3348a9c", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "seed": 4222824524, 
                    "width": 512, 
                    "height": 512, 
                    "use_cpu": true, 
                    "type": "noise"
                }, 
                "d0de57fa-e888-47cb-a8fd-71a8a1435c52": {
                    "id": "d0de57fa-e888-47cb-a8fd-71a8a1435c52", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "generation_mode": "txt2img", 
                    "positive_prompt": "", 
                    "negative_prompt": "", 
                    "width": 512, 
                    "height": 512, 
                    "seed": 4222824524, 
                    "rand_device": "cpu", 
                    "cfg_scale": 7.5, 
                    "cfg_rescale_multiplier": 0, 
                    "steps": 30, 
                    "scheduler": "dpmpp_3m_k", 
                    "clip_skip": 0, 
                    "model": {
                        "key" : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash": "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name": "Dreamshaper 8"                                                          , 
                        "base": "sd-1"                                                                   , 
                        "type": "main"                                                                     
                    }, 
                    "type": "core_metadata", 
                    "regions": [], 
                    "canvas_v2_metadata": {
                        "referenceImages": [], 
                        "controlLayers": [], 
                        "inpaintMasks": [
                            {
                                "id": "inpaint_mask:sstGjgUSek", 
                                "name": null, 
                                "type": "inpaint_mask", 
                                "isEnabled": true, 
                                "isLocked": false, 
                                "objects": [], 
                                "opacity": 1, 
                                "position": {"x": 0, "y": 0}, 
                                "fill": { "style": "diagonal", "color": {"r": 224, "g": 117, "b": 117} }
                            }
                        ], 
                        "rasterLayers": [], 
                        "regionalGuidance": []
                    }
                }, 
                "4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c": {
                    "id": "4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "clip": {
                        "tokenizer": {
                            "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                            "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                            "name"         : "Dreamshaper 8"                                                          , 
                            "base"         : "sd-1"                                                                   , 
                            "type"         : "main"                                                                   , 
                            "submodel_type": "tokenizer"                                                                
                        }, 
                        "text_encoder": {
                            "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                            "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                            "name"         : "Dreamshaper 8"                                                          , 
                            "base"         : "sd-1"                                                                   , 
                            "type"         : "main"                                                                   , 
                            "submodel_type": "text_encoder"                                                             
                        }, 
                        "skipped_layers": 0, 
                        "loras": []
                    }, 
                    "skipped_layers": 0, 
                    "type": "clip_skip"
                }, 
                "32bd4142-2012-47eb-87c9-10ac2bd8c4f0": {
                    "id": "32bd4142-2012-47eb-87c9-10ac2bd8c4f0", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "prompt": "", 
                    "clip": {
                        "tokenizer": {
                            "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                            "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                            "name"         : "Dreamshaper 8"                                                          , 
                            "base"         : "sd-1"                                                                   , 
                            "type"         : "main"                                                                   , 
                            "submodel_type": "tokenizer"                                                                
                        }, 
                        "text_encoder": {
                            "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                            "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                            "name"         : "Dreamshaper 8"                                                          , 
                            "base"         : "sd-1"                                                                   , 
                            "type"         : "main"                                                                   , 
                            "submodel_type": "text_encoder"                                                             
                        }, 
                        "skipped_layers": 0, 
                        "loras": []
                    }, 
                    "type": "compel"
                }, 
                "9f1c479c-ec9a-4da9-b750-79be78bfab09": {
                    "id": "9f1c479c-ec9a-4da9-b750-79be78bfab09", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "prompt": "", 
                    "clip": {
                        "tokenizer": {
                            "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                            "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                            "name"         : "Dreamshaper 8"                                                          , 
                            "base"         : "sd-1"                                                                   , 
                            "type"         : "main"                                                                   , 
                            "submodel_type": "tokenizer"                                                                
                        }, 
                        "text_encoder": {
                            "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                            "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                            "name"         : "Dreamshaper 8"                                                          , 
                            "base"         : "sd-1"                                                                   , 
                            "type"         : "main"                                                                   , 
                            "submodel_type": "text_encoder"                                                             
                        }, 
                        "skipped_layers": 0, 
                        "loras": []
                    }, 
                    "type": "compel"
                }, 
                "c2cb2127-15fc-4362-b17e-46d1d475e22a": {
                    "id": "c2cb2127-15fc-4362-b17e-46d1d475e22a", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "collection": [
                        {"conditioning_name": "ConditioningFieldData_2806b214-8be4-44eb-88bf-855e531bc734"}
                    ], 
                    "type": "collect"
                }, 
                "61929345-6bb9-42f6-be20-904f71d3f2f8": {
                    "id": "61929345-6bb9-42f6-be20-904f71d3f2f8", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "collection": [
                        {"conditioning_name": "ConditioningFieldData_2806b214-8be4-44eb-88bf-855e531bc734"}
                    ], 
                    "type": "collect"
                }, 
                "9fa7970f-1bee-4e1f-a9fe-d077ceca3607": {
                    "id": "9fa7970f-1bee-4e1f-a9fe-d077ceca3607", 
                    "is_intermediate": true, 
                    "use_cache": true, 
                    "positive_conditioning": [
                        {"conditioning_name": "ConditioningFieldData_2806b214-8be4-44eb-88bf-855e531bc734"}
                    ], 
                    "negative_conditioning": [
                        {"conditioning_name": "ConditioningFieldData_2806b214-8be4-44eb-88bf-855e531bc734"}
                    ], 
                    "noise": {"latents_name": "Tensor_c049a091-2afc-4246-90ae-291481ce1bca", "seed": 4222824524}, 
                    "steps": 30, 
                    "cfg_scale": 7.5, 
                    "denoising_start": 0, 
                    "denoising_end": 1, 
                    "scheduler": "dpmpp_3m_k", 
                    "unet": {
                        "unet": {
                            "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                            "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                            "name"         : "Dreamshaper 8"                                                          , 
                            "base"         : "sd-1"                                                                   , 
                            "type"         : "main"                                                                   , 
                            "submodel_type": "unet"                                                                     
                        }, 
                        "scheduler": {
                            "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                            "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                            "name"         : "Dreamshaper 8"                                                          , 
                            "base"         : "sd-1"                                                                   , 
                            "type"         : "main"                                                                   , 
                            "submodel_type": "scheduler"                                                                
                        }, 
                        "loras": [], 
                        "seamless_axes": []
                    }, 
                    "cfg_rescale_multiplier": 0, 
                    "type": "denoise_latents"
                }, 
                "884994b2-1867-4952-9fd9-d95dbf50536c": {
                    "id": "884994b2-1867-4952-9fd9-d95dbf50536c", 
                    "is_intermediate": false, 
                    "use_cache": false, 
                    "tiled": false, 
                    "tile_size": 0, 
                    "fp32": true, 
                    "type": "l2i"
                }
            }, 
            "edges": [
                {
                    "source"     : {"node_id": "c2ee0957-6f0e-41f9-afaf-16c7d6c74051", "field": "clip"}, 
                    "destination": {"node_id": "4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c", "field": "clip"}  
                }, 
                {
                    "source"     : {"node_id": "4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c", "field": "clip"}, 
                    "destination": {"node_id": "32bd4142-2012-47eb-87c9-10ac2bd8c4f0", "field": "clip"}  
                }, 
                {
                    "source"     : {"node_id": "4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c", "field": "clip"}, 
                    "destination": {"node_id": "9f1c479c-ec9a-4da9-b750-79be78bfab09", "field": "clip"}  
                }, 
                {
                    "source"     : {"node_id": "32bd4142-2012-47eb-87c9-10ac2bd8c4f0", "field": "conditioning"}, 
                    "destination": {"node_id": "c2cb2127-15fc-4362-b17e-46d1d475e22a", "field": "item"        }  
                }, 
                {
                    "source"     : {"node_id": "9f1c479c-ec9a-4da9-b750-79be78bfab09", "field": "conditioning"}, 
                    "destination": {"node_id": "61929345-6bb9-42f6-be20-904f71d3f2f8", "field": "item"        }  
                }, 
                {
                    "source"     : {"node_id": "c2ee0957-6f0e-41f9-afaf-16c7d6c74051", "field": "unet"}, 
                    "destination": {"node_id": "9fa7970f-1bee-4e1f-a9fe-d077ceca3607", "field": "unet"}  
                }, 
                {
                    "source": {"node_id": "c2cb2127-15fc-4362-b17e-46d1d475e22a", "field": "collection"}, 
                    "destination": {"node_id": "9fa7970f-1bee-4e1f-a9fe-d077ceca3607", "field": "positive_conditioning"}
                }, 
                {
                    "source": {"node_id": "61929345-6bb9-42f6-be20-904f71d3f2f8", "field": "collection"}, 
                    "destination": {"node_id": "9fa7970f-1bee-4e1f-a9fe-d077ceca3607", "field": "negative_conditioning"}
                }, 
                {
                    "source"     : {"node_id": "a67d6405-af2f-42e0-aebd-04e2e3348a9c", "field": "noise"}, 
                    "destination": {"node_id": "9fa7970f-1bee-4e1f-a9fe-d077ceca3607", "field": "noise"}  
                }, 
                {
                    "source"     : {"node_id": "9fa7970f-1bee-4e1f-a9fe-d077ceca3607", "field": "latents"}, 
                    "destination": {"node_id": "884994b2-1867-4952-9fd9-d95dbf50536c", "field": "latents"}  
                }, 
                {
                    "source"     : {"node_id": "c2ee0957-6f0e-41f9-afaf-16c7d6c74051", "field": "vae"}, 
                    "destination": {"node_id": "884994b2-1867-4952-9fd9-d95dbf50536c", "field": "vae"}  
                }, 
                {
                    "source"     : {"node_id": "d0de57fa-e888-47cb-a8fd-71a8a1435c52", "field": "metadata"}, 
                    "destination": {"node_id": "884994b2-1867-4952-9fd9-d95dbf50536c", "field": "metadata"}  
                }
            ]
        }, 
        "executed": [
            "pos_cond:GPoNbVWrLo"                 , 
            "c2cb2127-15fc-4362-b17e-46d1d475e22a", 
            "neg_cond:UMywrXsVT3"                 , 
            "noise:RTSeTpWDuo"                    , 
            "a67d6405-af2f-42e0-aebd-04e2e3348a9c", 
            "clip_skip:mMUIMHyX96"                , 
            "pos_cond_collect:cqfOJITWfj"         , 
            "61929345-6bb9-42f6-be20-904f71d3f2f8", 
            "9f1c479c-ec9a-4da9-b750-79be78bfab09", 
            "neg_cond_collect:QAIPSKKNWH"         , 
            "c2ee0957-6f0e-41f9-afaf-16c7d6c74051", 
            "4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c", 
            "32bd4142-2012-47eb-87c9-10ac2bd8c4f0", 
            "sd1_model_loader:Zadf4O52nz"           
        ], 
        "executed_history": [
            "sd1_model_loader:Zadf4O52nz", "clip_skip:mMUIMHyX96"       , "neg_cond:UMywrXsVT3"        , 
            "neg_cond_collect:QAIPSKKNWH", "pos_cond:GPoNbVWrLo"        , "pos_cond_collect:cqfOJITWfj", 
            "noise:RTSeTpWDuo"           
        ], 
        "results": {
            "c2ee0957-6f0e-41f9-afaf-16c7d6c74051": {
                "vae": {
                    "vae": {
                        "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name"         : "Dreamshaper 8"                                                          , 
                        "base"         : "sd-1"                                                                   , 
                        "type"         : "main"                                                                   , 
                        "submodel_type": "vae"                                                                      
                    }, 
                    "seamless_axes": []
                }, 
                "type": "model_loader_output", 
                "clip": {
                    "tokenizer": {
                        "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name"         : "Dreamshaper 8"                                                          , 
                        "base"         : "sd-1"                                                                   , 
                        "type"         : "main"                                                                   , 
                        "submodel_type": "tokenizer"                                                                
                    }, 
                    "text_encoder": {
                        "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name"         : "Dreamshaper 8"                                                          , 
                        "base"         : "sd-1"                                                                   , 
                        "type"         : "main"                                                                   , 
                        "submodel_type": "text_encoder"                                                             
                    }, 
                    "skipped_layers": 0, 
                    "loras": []
                }, 
                "unet": {
                    "unet": {
                        "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name"         : "Dreamshaper 8"                                                          , 
                        "base"         : "sd-1"                                                                   , 
                        "type"         : "main"                                                                   , 
                        "submodel_type": "unet"                                                                     
                    }, 
                    "scheduler": {
                        "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name"         : "Dreamshaper 8"                                                          , 
                        "base"         : "sd-1"                                                                   , 
                        "type"         : "main"                                                                   , 
                        "submodel_type": "scheduler"                                                                
                    }, 
                    "loras": [], 
                    "seamless_axes": []
                }
            }, 
            "4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c": {
                "clip": {
                    "tokenizer": {
                        "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name"         : "Dreamshaper 8"                                                          , 
                        "base"         : "sd-1"                                                                   , 
                        "type"         : "main"                                                                   , 
                        "submodel_type": "tokenizer"                                                                
                    }, 
                    "text_encoder": {
                        "key"          : "9bcd475a-0acd-4e1a-988b-ea893948e909"                                   , 
                        "hash"         : "random:7a434ca2436126364430dd77f82dcdc0ddcf42a38d17dbf8a6a018cebc5c1329", 
                        "name"         : "Dreamshaper 8"                                                          , 
                        "base"         : "sd-1"                                                                   , 
                        "type"         : "main"                                                                   , 
                        "submodel_type": "text_encoder"                                                             
                    }, 
                    "skipped_layers": 0, 
                    "loras": []
                }, 
                "type": "clip_skip_output"
            }, 
            "9f1c479c-ec9a-4da9-b750-79be78bfab09": {
                "conditioning": {"conditioning_name": "ConditioningFieldData_2806b214-8be4-44eb-88bf-855e531bc734"}, 
                "type": "conditioning_output"
            }, 
            "61929345-6bb9-42f6-be20-904f71d3f2f8": {
                "collection": [ {"conditioning_name": "ConditioningFieldData_2806b214-8be4-44eb-88bf-855e531bc734"} ], 
                "type": "collect_output"
            }, 
            "32bd4142-2012-47eb-87c9-10ac2bd8c4f0": {
                "conditioning": {"conditioning_name": "ConditioningFieldData_2806b214-8be4-44eb-88bf-855e531bc734"}, 
                "type": "conditioning_output"
            }, 
            "c2cb2127-15fc-4362-b17e-46d1d475e22a": {
                "collection": [ {"conditioning_name": "ConditioningFieldData_2806b214-8be4-44eb-88bf-855e531bc734"} ], 
                "type": "collect_output"
            }, 
            "a67d6405-af2f-42e0-aebd-04e2e3348a9c": {
                "noise": {"latents_name": "Tensor_c049a091-2afc-4246-90ae-291481ce1bca", "seed": 4222824524}, 
                "width": 512, 
                "height": 512, 
                "type": "noise_output"
            }
        }, 
        "errors": {
            "9fa7970f-1bee-4e1f-a9fe-d077ceca3607": "ValueError: `final_sigmas_type` zero is not supported for `algorithm_type` deis. Please choose `sigma_min` instead."
        }, 
        "prepared_source_mapping": {
            "c2ee0957-6f0e-41f9-afaf-16c7d6c74051": "sd1_model_loader:Zadf4O52nz", 
            "a67d6405-af2f-42e0-aebd-04e2e3348a9c": "noise:RTSeTpWDuo"           , 
            "d0de57fa-e888-47cb-a8fd-71a8a1435c52": "core_metadata:eAruYq1gyS"   , 
            "4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c": "clip_skip:mMUIMHyX96"       , 
            "32bd4142-2012-47eb-87c9-10ac2bd8c4f0": "pos_cond:GPoNbVWrLo"        , 
            "9f1c479c-ec9a-4da9-b750-79be78bfab09": "neg_cond:UMywrXsVT3"        , 
            "c2cb2127-15fc-4362-b17e-46d1d475e22a": "pos_cond_collect:cqfOJITWfj", 
            "61929345-6bb9-42f6-be20-904f71d3f2f8": "neg_cond_collect:QAIPSKKNWH", 
            "9fa7970f-1bee-4e1f-a9fe-d077ceca3607": "denoise_latents:z2BRuJsm9K" , 
            "884994b2-1867-4952-9fd9-d95dbf50536c": "canvas_output:Q5turAM3MX"     
        }, 
        "source_prepared_mapping": {
            "sd1_model_loader:Zadf4O52nz": ["c2ee0957-6f0e-41f9-afaf-16c7d6c74051"], 
            "noise:RTSeTpWDuo"           : ["a67d6405-af2f-42e0-aebd-04e2e3348a9c"], 
            "core_metadata:eAruYq1gyS"   : ["d0de57fa-e888-47cb-a8fd-71a8a1435c52"], 
            "clip_skip:mMUIMHyX96"       : ["4f5f6a55-a06a-4255-a0f1-71bb7e3ae91c"], 
            "pos_cond:GPoNbVWrLo"        : ["32bd4142-2012-47eb-87c9-10ac2bd8c4f0"], 
            "neg_cond:UMywrXsVT3"        : ["9f1c479c-ec9a-4da9-b750-79be78bfab09"], 
            "pos_cond_collect:cqfOJITWfj": ["c2cb2127-15fc-4362-b17e-46d1d475e22a"], 
            "neg_cond_collect:QAIPSKKNWH": ["61929345-6bb9-42f6-be20-904f71d3f2f8"], 
            "denoise_latents:z2BRuJsm9K" : ["9fa7970f-1bee-4e1f-a9fe-d077ceca3607"], 
            "canvas_output:Q5turAM3MX"   : ["884994b2-1867-4952-9fd9-d95dbf50536c"]  
        }
    }
}

@ebr
Copy link
Member

ebr commented Oct 23, 2024

Tested CPU; with and without xformers; installation of all starter models; generated in many different ways on canvas, including controlnets (with all preprocessors) and ip-adapter. All LGTM

@Vargol
Copy link
Contributor

Vargol commented Oct 24, 2024

ValueError: final_sigmas_type zero is not supported for algorithm_type deis. Please choose sigma_min instead.

Seen that before It's an issue inherited from Diffusers I think.
#6368

I believe it's a combination of the scheduler config from the repo and the scheduler in use by InvokeAI. The load of the scheduler from default passes the config on , but sometimes they have bits in the config that the scheduler chosen in InvokeAI doesn't support. DreamShaper does it as its 'default' scheduler is DEIS which conflicts with DPM schedulers

@RyanJDick
Remove load_safety_checker=False from calls to from_single_file(...).
e887529 
This param has been deprecated, and by including it (even when set to
False) the safety checker automatically gets downloaded.
@RyanJDick
Remove unused prediction_type and upcast_attention from from_single_f…
ae327c7 
…ile(...) calls.
@RyanJDick
Copy link
Collaborator Author

I tested on MacOS (SD1.5 text-to-image, SDXL text-to-image, SD1.5 IP-Adapter, SD1.5 Controlnet, SD1.5 LoRA). Everything runs ok. The image outputs are changed slightly for the same seed. The cause of this is unknown, and it's probably not worth the effort to track it down.

@sonarqubecloud SonarQubeCloud
Copy link

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

@maryhipp maryhipp merged commit a2486a5 into main Oct 28, 2024
14 checks passed
@maryhipp maryhipp deleted the ryan/bump-diffusers branch October 28, 2024 17:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@brandonrising brandonrising brandonrising approved these changes

@hipsterusername hipsterusername hipsterusername approved these changes

@ebr ebr ebr approved these changes

@lstein lstein Awaiting requested review from lstein lstein is a code owner

@blessedcoolant blessedcoolant Awaiting requested review from blessedcoolant blessedcoolant is a code owner

Assignees
No one assigned
Labels
backend PRs that change backend files python PRs that change python files python-deps PRs that change python dependencies Root
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@RyanJDick @ebr @Vargol @hipsterusername @brandonrising @maryhipp