Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/controlnet extras #3596

Merged
merged 12 commits into from
Jun 28, 2023
Merged

Feat/controlnet extras #3596

merged 12 commits into from
Jun 28, 2023

Conversation

GreggHelt2
Copy link
Contributor

Trying to get a few ControlNet extras in before 3.0 release:

  • SegmentAnything ControlNet preprocessor node
  • LeResDepth ControlNet preprocessor node (but commented out till controlnet_aux v0.0.6 is released & required by InvokeAI)
  • TileResampler ControlNet preprocessor node (should be equivalent to Mikubill/sd-webui-controlnet extension tile_resampler)
  • fix for Midas ControlNet preprocessor error with images that have alpha channel

Example usage of SegmentAnything preprocessor node:
Screenshot from 2023-06-26 16-53-44

…entAnything preprocessor. Cause was controlnet_aux randomization of segmentation coloring, which seems to lead to some randomization of resulting images using ControlNet seg model. Switched to using deterministic ADE20K color palette instead, which solved the problem.
…ontrolnet_aux v0.0.6 (supported on controlnet_aux current main, but not on latest release v0.0.5)
Also fixes to SegmentAnything ControlNet preprocessor node.
…mat then convert to RGB (otherwise MediapipeFace image processing throws an error)
@blessedcoolant blessedcoolant merged commit 201b843 into main Jun 28, 2023
6 checks passed
@blessedcoolant blessedcoolant deleted the feat/controlnet_extras branch June 28, 2023 05:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants