From cbf2b2e78fa951806f65640a3603810aa0a55f65 Mon Sep 17 00:00:00 2001
From: mickr777 <115216705+mickr777@users.noreply.github.com>
Date: Fri, 13 Oct 2023 19:04:29 +1100
Subject: [PATCH 1/2] Clean up communityNodes.md
---
docs/nodes/communityNodes.md | 313 ++++++++++++++++++-----------------
1 file changed, 163 insertions(+), 150 deletions(-)
diff --git a/docs/nodes/communityNodes.md b/docs/nodes/communityNodes.md
index 47ed407695b..c03d630f67f 100644
--- a/docs/nodes/communityNodes.md
+++ b/docs/nodes/communityNodes.md
@@ -8,28 +8,42 @@ To download a node, simply download the `.py` node file from the link and add it
To use a community workflow, download the the `.json` node graph file and load it into Invoke AI via the **Load Workflow** button in the Workflow Editor.
---------------------------------
-
---------------------------------
-### Make 3D
-
-**Description:** Create compelling 3D stereo images from 2D originals.
-
-**Node Link:** [https://gitlab.com/srcrr/shift3d/-/raw/main/make3d.py](https://gitlab.com/srcrr/shift3d)
+- Community Nodes
+ + [Depth Map from Wavefront OBJ](#depth-map-from-wavefront-obj)
+ + [Film Grain](#film-grain)
+ + [Generative Grammar-Based Prompt Nodes](#generative-grammar-based-prompt-nodes)
+ + [GPT2RandomPromptMaker](#gpt2randompromptmaker)
+ + [Grid to Gif](#grid-to-gif)
+ + [Halftone](#halftone)
+ + [Ideal Size](#ideal-size)
+ + [Image and Mask Composition Pack](#image-and-mask-composition-pack)
+ + [Image to Character Art Image Nodes](#image-to-character-art-image-nodes)
+ + [Image Picker](#image-picker)
+ + [Load Video Frame](#load-video-frame)
+ + [Make 3D](#make-3d)
+ + [Oobabooga](#oobabooga)
+ + [Prompt Tools](#prompt-tools)
+ + [Retroize](#retroize)
+ + [Size Stepper Nodes](#size-stepper-nodes)
+ + [Text font to Image](#text-font-to-image)
+ + [Thresholding](#thresholding)
+ + [XY Image to Grid and Images to Grids nodes](#xy-image-to-grid-and-images-to-grids-nodes)
+- [Example Node Template](#example-node-template)
+- [Disclaimer](#disclaimer)
+- [Help](#help)
-**Example Node Graph:** https://gitlab.com/srcrr/shift3d/-/raw/main/example-workflow.json?ref_type=heads&inline=false
-**Output Examples**
+--------------------------------
+### Depth Map from Wavefront OBJ
-{: style="height:512px;width:512px"}
-{: style="height:512px;width:512px"}
+**Description:** Render depth maps from Wavefront .obj files (triangulated) using this simple 3D renderer utilizing numpy and matplotlib to compute and color the scene. There are simple parameters to change the FOV, camera position, and model orientation.
---------------------------------
-### Ideal Size
+To be imported, an .obj must use triangulated meshes, so make sure to enable that option if exporting from a 3D modeling program. This renderer makes each triangle a solid color based on its average depth, so it will cause anomalies if your .obj has large triangles. In Blender, the Remesh modifier can be helpful to subdivide a mesh into small pieces that work well given these limitations.
-**Description:** This node calculates an ideal image size for a first pass of a multi-pass upscaling. The aim is to avoid duplication that results from choosing a size larger than the model is capable of.
+**Node Link:** https://github.com/dwringer/depth-from-obj-node
-**Node Link:** https://github.com/JPPhoto/ideal-size-node
+**Example Usage:**
+
--------------------------------
### Film Grain
@@ -39,36 +53,46 @@ To use a community workflow, download the the `.json` node graph file and load i
**Node Link:** https://github.com/JPPhoto/film-grain-node
--------------------------------
-### Image Picker
+### Generative Grammar-Based Prompt Nodes
-**Description:** This InvokeAI node takes in a collection of images and randomly chooses one. This can be useful when you have a number of poses to choose from for a ControlNet node, or a number of input images for another purpose.
+**Description:** This set of 3 nodes generates prompts from simple user-defined grammar rules (loaded from custom files - examples provided below). The prompts are made by recursively expanding a special template string, replacing nonterminal "parts-of-speech" until no nonterminal terms remain in the string.
-**Node Link:** https://github.com/JPPhoto/image-picker-node
+This includes 3 Nodes:
+- *Lookup Table from File* - loads a YAML file "prompt" section (or of a whole folder of YAML's) into a JSON-ified dictionary (Lookups output)
+- *Lookups Entry from Prompt* - places a single entry in a new Lookups output under the specified heading
+- *Prompt from Lookup Table* - uses a Collection of Lookups as grammar rules from which to randomly generate prompts.
+
+**Node Link:** https://github.com/dwringer/generative-grammar-prompt-nodes
+
+**Example Usage:**
+
--------------------------------
-### Thresholding
+### GPT2RandomPromptMaker
-**Description:** This node generates masks for highlights, midtones, and shadows given an input image. You can optionally specify a blur for the lookup table used in making those masks from the source image.
+**Description:** A node for InvokeAI utilizes the GPT-2 language model to generate random prompts based on a provided seed and context.
-**Node Link:** https://github.com/JPPhoto/thresholding-node
+**Node Link:** https://github.com/mickr777/GPT2RandomPromptMaker
-**Examples**
+**Output Examples**
-Input:
+Generated Prompt: An enchanted weapon will be usable by any character regardless of their alignment.
-{: style="height:512px;width:512px"}
+
-Highlights/Midtones/Shadows:
+--------------------------------
+### Grid to Gif
-
-
-
+**Description:** One node that turns a grid image into an image collection, one node that turns an image collection into a gif.
-Highlights/Midtones/Shadows (with LUT blur enabled):
+**Node Link:** https://github.com/mildmisery/invokeai-GridToGifNode/blob/main/GridToGif.py
-
-
-
+**Example Node Graph:** https://github.com/mildmisery/invokeai-GridToGifNode/blob/main/Grid%20to%20Gif%20Example%20Workflow.json
+
+**Output Examples**
+
+
+
--------------------------------
### Halftone
@@ -81,44 +105,75 @@ Highlights/Midtones/Shadows (with LUT blur enabled):
Input:
-{: style="height:512px;width:512px"}
+
Halftone Output:
-{: style="height:512px;width:512px"}
+
CMYK Halftone Output:
-{: style="height:512px;width:512px"}
+
--------------------------------
-### Retroize
+### Ideal Size
-**Description:** Retroize is a collection of nodes for InvokeAI to "Retroize" images. Any image can be given a fresh coat of retro paint with these nodes, either from your gallery or from within the graph itself. It includes nodes to pixelize, quantize, palettize, and ditherize images; as well as to retrieve palettes from existing images.
+**Description:** This node calculates an ideal image size for a first pass of a multi-pass upscaling. The aim is to avoid duplication that results from choosing a size larger than the model is capable of.
-**Node Link:** https://github.com/Ar7ific1al/invokeai-retroizeinode/
+**Node Link:** https://github.com/JPPhoto/ideal-size-node
-**Retroize Output Examples**
+--------------------------------
+### Image and Mask Composition Pack
+
+**Description:** This is a pack of nodes for composing masks and images, including a simple text mask creator and both image and latent offset nodes. The offsets wrap around, so these can be used in conjunction with the Seamless node to progressively generate centered on different parts of the seamless tiling.
+
+This includes 15 Nodes:
+
+- *Adjust Image Hue Plus* - Rotate the hue of an image in one of several different color spaces.
+- *Blend Latents/Noise (Masked)* - Use a mask to blend part of one latents tensor [including Noise outputs] into another. Can be used to "renoise" sections during a multi-stage [masked] denoising process.
+- *Enhance Image* - Boost or reduce color saturation, contrast, brightness, sharpness, or invert colors of any image at any stage with this simple wrapper for pillow [PIL]'s ImageEnhance module.
+- *Equivalent Achromatic Lightness* - Calculates image lightness accounting for Helmholtz-Kohlrausch effect based on a method described by High, Green, and Nussbaum (2023).
+- *Text to Mask (Clipseg)* - Input a prompt and an image to generate a mask representing areas of the image matched by the prompt.
+- *Text to Mask Advanced (Clipseg)* - Output up to four prompt masks combined with logical "and", logical "or", or as separate channels of an RGBA image.
+- *Image Layer Blend* - Perform a layered blend of two images using alpha compositing. Opacity of top layer is selectable, with optional mask and several different blend modes/color spaces.
+- *Image Compositor* - Take a subject from an image with a flat backdrop and layer it on another image using a chroma key or flood select background removal.
+- *Image Dilate or Erode* - Dilate or expand a mask (or any image!). This is equivalent to an expand/contract operation.
+- *Image Value Thresholds* - Clip an image to pure black/white beyond specified thresholds.
+- *Offset Latents* - Offset a latents tensor in the vertical and/or horizontal dimensions, wrapping it around.
+- *Offset Image* - Offset an image in the vertical and/or horizontal dimensions, wrapping it around.
+- *Rotate/Flip Image* - Rotate an image in degrees clockwise/counterclockwise about its center, optionally resizing the image boundaries to fit, or flipping it about the vertical and/or horizontal axes.
+- *Shadows/Highlights/Midtones* - Extract three masks (with adjustable hard or soft thresholds) representing shadows, midtones, and highlights regions of an image.
+- *Text Mask (simple 2D)* - create and position a white on black (or black on white) line of text using any font locally available to Invoke.
+
+
-
+**Node Link:** https://github.com/dwringer/composition-nodes
--------------------------------
-### GPT2RandomPromptMaker
+### Image to Character Art Image Nodes
-**Description:** A node for InvokeAI utilizes the GPT-2 language model to generate random prompts based on a provided seed and context.
+**Description:** Group of nodes to convert an input image into ascii/unicode art Image
-**Node Link:** https://github.com/mickr777/GPT2RandomPromptMaker
+**Node Link:** https://github.com/mickr777/imagetoasciiimage
-**Output Examples**
+**Output Examples**
-Generated Prompt: An enchanted weapon will be usable by any character regardless of their alignment.
+
+
+
-
+--------------------------------
+
+### Image Picker
+
+**Description:** This InvokeAI node takes in a collection of images and randomly chooses one. This can be useful when you have a number of poses to choose from for a ControlNet node, or a number of input images for another purpose.
+
+**Node Link:** https://github.com/JPPhoto/image-picker-node
--------------------------------
### Load Video Frame
-**Description:** This is a video frame image provider + indexer/video creation nodes for hooking up to iterators and ranges and ControlNets and such for invokeAI node experimentation. Think animation + ControlNet outputs.
+**Description:** This is a video frame image provider + indexer/video creation nodes for hooking up to iterators and ranges and ControlNets and such for invokeAI node experimentation. Think animation + ControlNet outputs.
**Node Link:** https://github.com/helix4u/load_video_frame
@@ -126,18 +181,30 @@ Generated Prompt: An enchanted weapon will be usable by any character regardless
**Output Example:**
-
+
[Full mp4 of Example Output test.mp4](https://github.com/helix4u/load_video_frame/blob/main/test.mp4)
--------------------------------
+### Make 3D
+
+**Description:** Create compelling 3D stereo images from 2D originals.
+
+**Node Link:** [https://gitlab.com/srcrr/shift3d/-/raw/main/make3d.py](https://gitlab.com/srcrr/shift3d)
+
+**Example Node Graph:** https://gitlab.com/srcrr/shift3d/-/raw/main/example-workflow.json?ref_type=heads&inline=false
+
+**Output Examples**
+
+
+
+--------------------------------
### Oobabooga
**Description:** asks a local LLM running in Oobabooga's Text-Generation-Webui to write a prompt based on the user input.
**Link:** https://github.com/sammyf/oobabooga-node
-
**Example:**
"describe a new mystical creature in its natural environment"
@@ -147,7 +214,7 @@ Generated Prompt: An enchanted weapon will be usable by any character regardless
"The mystical creature I am describing to you is called the "Glimmerwing". It is a majestic, iridescent being that inhabits the depths of the most enchanted forests and glimmering lakes. Its body is covered in shimmering scales that reflect every color of the rainbow, and it has delicate, translucent wings that sparkle like diamonds in the sunlight. The Glimmerwing's home is a crystal-clear lake, surrounded by towering trees with leaves that shimmer like jewels. In this serene environment, the Glimmerwing spends its days swimming gracefully through the water, chasing schools of glittering fish and playing with the gentle ripples of the lake's surface.
As the sun sets, the Glimmerwing perches on a branch of one of the trees, spreading its wings to catch the last rays of light. The creature's scales glow softly, casting a rainbow of colors across the forest floor. The Glimmerwing sings a haunting melody, its voice echoing through the stillness of the night air. Its song is said to have the power to heal the sick and bring peace to troubled souls. Those who are lucky enough to hear the Glimmerwing's song are forever changed by its beauty and grace."
-
+
**Requirement**
@@ -155,62 +222,37 @@ a Text-Generation-Webui instance (might work remotely too, but I never tried it)
**Note**
-This node works best with SDXL models, especially as the style can be described independantly of the LLM's output.
-
---------------------------------
-### Depth Map from Wavefront OBJ
-
-**Description:** Render depth maps from Wavefront .obj files (triangulated) using this simple 3D renderer utilizing numpy and matplotlib to compute and color the scene. There are simple parameters to change the FOV, camera position, and model orientation.
-
-To be imported, an .obj must use triangulated meshes, so make sure to enable that option if exporting from a 3D modeling program. This renderer makes each triangle a solid color based on its average depth, so it will cause anomalies if your .obj has large triangles. In Blender, the Remesh modifier can be helpful to subdivide a mesh into small pieces that work well given these limitations.
-
-**Node Link:** https://github.com/dwringer/depth-from-obj-node
-
-**Example Usage:**
-
+This node works best with SDXL models, especially as the style can be described independently of the LLM's output.
--------------------------------
-### Generative Grammar-Based Prompt Nodes
+### Prompt Tools
-**Description:** This set of 3 nodes generates prompts from simple user-defined grammar rules (loaded from custom files - examples provided below). The prompts are made by recursively expanding a special template string, replacing nonterminal "parts-of-speech" until no more nonterminal terms remain in the string.
+**Description:** A set of InvokeAI nodes that add general prompt manipulation tools. These were written to accompany the PromptsFromFile node and other prompt generation nodes.
-This includes 3 Nodes:
-- *Lookup Table from File* - loads a YAML file "prompt" section (or of a whole folder of YAML's) into a JSON-ified dictionary (Lookups output)
-- *Lookups Entry from Prompt* - places a single entry in a new Lookups output under the specified heading
-- *Prompt from Lookup Table* - uses a Collection of Lookups as grammar rules from which to randomly generate prompts.
+1. PromptJoin - Joins to prompts into one.
+2. PromptReplace - performs a search and replace on a prompt. With the option of using regex.
+3. PromptSplitNeg - splits a prompt into positive and negative using the old V2 method of [] for negative.
+4. PromptToFile - saves a prompt or collection of prompts to a file. one per line. There is an append/overwrite option.
+5. PTFieldsCollect - Converts image generation fields into a Json format string that can be passed to Prompt to file.
+6. PTFieldsExpand - Takes Json string and converts it to individual generation parameters This can be fed from the Prompts to file node.
+7. PromptJoinThree - Joins 3 prompt together.
+8. PromptStrength - This take a string and float and outputs another string in the format of (string)strength like the weighted format of compel.
+9. PromptStrengthCombine - This takes a collection of prompt strength strings and outputs a string in the .and() or .blend() format that can be fed into a proper prompt node.
-**Node Link:** https://github.com/dwringer/generative-grammar-prompt-nodes
+See full docs here: https://github.com/skunkworxdark/Prompt-tools-nodes/edit/main/README.md
-**Example Usage:**
-
+**Node Link:** https://github.com/skunkworxdark/Prompt-tools-nodes
--------------------------------
-### Image and Mask Composition Pack
-
-**Description:** This is a pack of nodes for composing masks and images, including a simple text mask creator and both image and latent offset nodes. The offsets wrap around, so these can be used in conjunction with the Seamless node to progressively generate centered on different parts of the seamless tiling.
+### Retroize
-This includes 15 Nodes:
+**Description:** Retroize is a collection of nodes for InvokeAI to "Retroize" images. Any image can be given a fresh coat of retro paint with these nodes, either from your gallery or from within the graph itself. It includes nodes to pixelize, quantize, palettize, and ditherize images; as well as to retrieve palettes from existing images.
-- *Adjust Image Hue Plus* - Rotate the hue of an image in one of several different color spaces.
-- *Blend Latents/Noise (Masked)* - Use a mask to blend part of one latents tensor [including Noise outputs] into another. Can be used to "renoise" sections during a multi-stage [masked] denoising process.
-- *Enhance Image* - Boost or reduce color saturation, contrast, brightness, sharpness, or invert colors of any image at any stage with this simple wrapper for pillow [PIL]'s ImageEnhance module.
-- *Equivalent Achromatic Lightness* - Calculates image lightness accounting for Helmholtz-Kohlrausch effect based on a method described by High, Green, and Nussbaum (2023).
-- *Text to Mask (Clipseg)* - Input a prompt and an image to generate a mask representing areas of the image matched by the prompt.
-- *Text to Mask Advanced (Clipseg)* - Output up to four prompt masks combined with logical "and", logical "or", or as separate channels of an RGBA image.
-- *Image Layer Blend* - Perform a layered blend of two images using alpha compositing. Opacity of top layer is selectable, with optional mask and several different blend modes/color spaces.
-- *Image Compositor* - Take a subject from an image with a flat backdrop and layer it on another image using a chroma key or flood select background removal.
-- *Image Dilate or Erode* - Dilate or expand a mask (or any image!). This is equivalent to an expand/contract operation.
-- *Image Value Thresholds* - Clip an image to pure black/white beyond specified thresholds.
-- *Offset Latents* - Offset a latents tensor in the vertical and/or horizontal dimensions, wrapping it around.
-- *Offset Image* - Offset an image in the vertical and/or horizontal dimensions, wrapping it around.
-- *Rotate/Flip Image* - Rotate an image in degrees clockwise/counterclockwise about its center, optionally resizing the image boundaries to fit, or flipping it about the vertical and/or horizontal axes.
-- *Shadows/Highlights/Midtones* - Extract three masks (with adjustable hard or soft thresholds) representing shadows, midtones, and highlights regions of an image.
-- *Text Mask (simple 2D)* - create and position a white on black (or black on white) line of text using any font locally available to Invoke.
+**Node Link:** https://github.com/Ar7ific1al/invokeai-retroizeinode/
-**Node Link:** https://github.com/dwringer/composition-nodes
+**Retroize Output Examples**
-**Nodes and Output Examples:**
-
+
--------------------------------
### Size Stepper Nodes
@@ -222,10 +264,9 @@ A third node is included, *Random Switch (Integers)*, which is just a generic ve
**Node Link:** https://github.com/dwringer/size-stepper-nodes
**Example Usage:**
-
+
--------------------------------
-
### Text font to Image
**Description:** text font to text image node for InvokeAI, download a font to use (or if in font cache uses it from there), the text is always resized to the image size, but can control that with padding, optional 2nd line
@@ -234,80 +275,52 @@ A third node is included, *Random Switch (Integers)*, which is just a generic ve
**Output Examples**
-
+
Results after using the depth controlnet
-
-
-
+
+
+
--------------------------------
+### Thresholding
-### Prompt Tools
-
-**Description:** A set of InvokeAI nodes that add general prompt manipulation tools. These where written to accompany the PromptsFromFile node and other prompt generation nodes.
-
-1. PromptJoin - Joins to prompts into one.
-2. PromptReplace - performs a search and replace on a prompt. With the option of using regex.
-3. PromptSplitNeg - splits a prompt into positive and negative using the old V2 method of [] for negative.
-4. PromptToFile - saves a prompt or collection of prompts to a file. one per line. There is an append/overwrite option.
-5. PTFieldsCollect - Converts image generation fields into a Json format string that can be passed to Prompt to file.
-6. PTFieldsExpand - Takes Json string and converts it to individual generation parameters This can be fed from the Prompts to file node.
-7. PromptJoinThree - Joins 3 prompt together.
-8. PromptStrength - This take a string and float and outputs another string in the format of (string)strength like the weighted format of compel.
-9. PromptStrengthCombine - This takes a collection of prompt strength strings and outputs a string in the .and() or .blend() format that can be fed into a proper prompt node.
-
-See full docs here: https://github.com/skunkworxdark/Prompt-tools-nodes/edit/main/README.md
-
-**Node Link:** https://github.com/skunkworxdark/Prompt-tools-nodes
-
---------------------------------
-
-### XY Image to Grid and Images to Grids nodes
-
-**Description:** Image to grid nodes and supporting tools.
-
-1. "Images To Grids" node - Takes a collection of images and creates a grid(s) of images. If there are more images than the size of a single grid then mutilple grids will be created until it runs out of images.
-2. "XYImage To Grid" node - Converts a collection of XYImages into a labeled Grid of images. The XYImages collection has to be built using the supporoting nodes. See example node setups for more details.
-
+**Description:** This node generates masks for highlights, midtones, and shadows given an input image. You can optionally specify a blur for the lookup table used in making those masks from the source image.
-See full docs here: https://github.com/skunkworxdark/XYGrid_nodes/edit/main/README.md
+**Node Link:** https://github.com/JPPhoto/thresholding-node
-**Node Link:** https://github.com/skunkworxdark/XYGrid_nodes
+**Examples**
---------------------------------
+Input:
-### Image to Character Art Image Node's
+
-**Description:** Group of nodes to convert an input image into ascii/unicode art Image
+Highlights/Midtones/Shadows:
-**Node Link:** https://github.com/mickr777/imagetoasciiimage
+
+
+
-**Output Examples**
+Highlights/Midtones/Shadows (with LUT blur enabled):
-
-
-
-
+
+
+
--------------------------------
+### XY Image to Grid and Images to Grids nodes
-### Grid to Gif
-
-**Description:** One node that turns a grid image into an image colletion, one node that turns an image collection into a gif
-
-**Node Link:** https://github.com/mildmisery/invokeai-GridToGifNode/blob/main/GridToGif.py
+**Description:** Image to grid nodes and supporting tools.
-**Example Node Graph:** https://github.com/mildmisery/invokeai-GridToGifNode/blob/main/Grid%20to%20Gif%20Example%20Workflow.json
+1. "Images To Grids" node - Takes a collection of images and creates a grid(s) of images. If there are more images than the size of a single grid then multiple grids will be created until it runs out of images.
+2. "XYImage To Grid" node - Converts a collection of XYImages into a labeled Grid of images. The XYImages collection has to be built using the supporting nodes. See example node setups for more details.
-**Output Examples**
+See full docs here: https://github.com/skunkworxdark/XYGrid_nodes/edit/main/README.md
-
-
+**Node Link:** https://github.com/skunkworxdark/XYGrid_nodes
--------------------------------
-
### Example Node Template
**Description:** This node allows you to do super cool things with InvokeAI.
@@ -318,7 +331,7 @@ See full docs here: https://github.com/skunkworxdark/XYGrid_nodes/edit/main/READ
**Output Examples**
-{: style="height:115px;width:240px"}
+
## Disclaimer
From 4d7e3d4b9693abca76d4477c7326c2a3e195d47f Mon Sep 17 00:00:00 2001
From: mickr777 <115216705+mickr777@users.noreply.github.com>
Date: Sun, 15 Oct 2023 06:11:09 +1100
Subject: [PATCH 2/2] Update communityNodes.md
---
docs/nodes/communityNodes.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/docs/nodes/communityNodes.md b/docs/nodes/communityNodes.md
index c03d630f67f..d5a5d5654f8 100644
--- a/docs/nodes/communityNodes.md
+++ b/docs/nodes/communityNodes.md
@@ -144,10 +144,10 @@ This includes 15 Nodes:
- *Rotate/Flip Image* - Rotate an image in degrees clockwise/counterclockwise about its center, optionally resizing the image boundaries to fit, or flipping it about the vertical and/or horizontal axes.
- *Shadows/Highlights/Midtones* - Extract three masks (with adjustable hard or soft thresholds) representing shadows, midtones, and highlights regions of an image.
- *Text Mask (simple 2D)* - create and position a white on black (or black on white) line of text using any font locally available to Invoke.
-
-
**Node Link:** https://github.com/dwringer/composition-nodes
+
+
--------------------------------
### Image to Character Art Image Nodes