Skip to content

Latest commit

 

History

History
229 lines (196 loc) · 22.2 KB

README.md

File metadata and controls

229 lines (196 loc) · 22.2 KB

Stable Diffusion Akashic Records

"Sic itur ad astra"

A compendium of information regarding Stable Diffusion (SD)

Pull Requests The Unlicense


This repository is a collection of studies, art styles, prompts and other useful tools you can use throughout your exploration of the latent space.

As Stable Diffusion is still in beta and subject to lots of changes, the Records will often change to reflect new information.

📔 Table of Contents

General information [ToC]

The Records

SD is brand new. As such, not many resources exist which are solely based on it.
To differentiate between other AI imagery tools and SD, the Records will use the following nomenclature :

🔹 Resource based on SD
🔸 Resource based on other AI imagery
🔺 Resource not based on any AI imagery (such as photography terms)

Stable Diffusion

To use SD, you can access the official DreamStudio website or use the Open-Source Model

Keep in mind the following :

  • Your prompt must be 75 tokens or less, anything above will result in "prompt truncated after tokenization"
  • Your prompt is case insensitive
  • There's about 30,000 tokens understood by the AI, this means it won't know about some weird word unused since the 1600s
  • A token is roughly a word, a punctuation, or a Unicode character
  • Same prompt, same seed, same modifiers will end with the same result
  • To make variations of an image, it's recommended to keep the seed and slightly alter the prompt / modifiers

Guides

🔹 Stable Diffusion Ultimate Beginner’s Guide
🔹 Stable Diffusion/Dreamstudio Guide
🔹 SD Launch Presentation
🔹 Creating cute animals with SD
🔹 Exactly How Stable Diffusion Generates Art
🔹 Seed Editing
🔹 SD Guide for artists and non-artists
🔹 Understanding SD through teapots
🔹 Beginner/Intermediate Guide to Getting Cool Images from Stable Diffusion
🔹 CDCruz's SD Guide
🔹 DreamStudio Tips&Tricks
🔹 SD Windows Installation Guide
🔹 SD Installation Guide for LStein and Basujindal forks
🔹 Awesome SD
🔹 4chan /g/ wiki
🔹 SD Training Guide
🔹 List of SD systems
🔹 r/StableDiffusion wiki
🔹 Improve 3D renders with SD
🔸 The DALLE-2 Prompt Book

Colabs / Repos / Websites to use SD

🔹 HuggingFace Space
🔹 SD Notebook with KLMS sampling
🔹 SD with 🧨 diffusers
🔹 SD Researcher
🔹 Prompt-space Interpolation
🔹 SD with Queing and Google Drive
🔹 SD on Colab (Collection of colabs)
🔹 Optimized SD repository
🔹 Dezgo
🔹 Deforum SD - Deforum's animation capabilities may also be accessed through Automatic1111's Web UI with script.
🔹 SD on CPU repository
🔹 InvokeAI (formerly lstein/stable-diffusion), lots of shiny new features
🔹 SD Docker w/ JupyterLab
🔹 Prog Rock Stable, SD w/ Proggy Enhancements
🔹 SD Animation
🔹 AUTOMATIC1111's SD Web UI repository, includes colab link
🔹 SD back-ported to OpenAI guided diffusion codebase
🔹 Richservo's SD GUI
🔹 Dreambooth on SD
🔹 NMKD SD GUI
🔹 Tileable Texture Generator
🔹 SD Morphing between images and its explanation (in JP)
🔹 Stable Diffusion UI v2 - A simple 1-click way to install and use SD on your own computer
🔹 Find the most important modifiers in your prompt - A tool that helps you rank modifiers in your prompt using similarity scores.
🔹 Diffusion-UI - A responsive frontend for easy inpainting working with multiple backends including AUTOMATIC1111 and the Stable Horde online cluster.
🔹 Synesthetic - A prompt search engine and generator focused on remixing

Plugins

🔹 Krita SD Plugin
🔹 auto-sd-krita - Krita plugin built on top of AUTOMATIC1111's fork with an optimized focus inpainting workflow supporting multiple models, useful for advanced multi-character composition.
🔹 Krita Stable Diffusion
🔹 Blender Texture Plugin
🔹 CEB Stable Diffusion - Blender Plugin.
🔹 GIMP SD

Checkpoints and Embeddings

Note that running arbitrary untrusted .ckpt and .pt files are not advised as they may be malicious.

🔹 Stable Diffusion v1.4
🔹 Waifu Diffusion, (Model v1.3)
🔹 Robo-diffusion (Model)
🔹 Pokemon SD (Model)
🔹 Stable Diffusion Models (NSFW)
🔹 Public prompt's Dreambooth model - Pixel Art, App Icons
🔹 Concepts Library
🔹 SD Textual Inversion Embedding - based off the previous link. Can be used in conjunction with embedding-to-png to create shareable TI embeddings. (Using .png rather than .pt is safer for sharing as .pt files can potentially be malicious.)

Studies [ToC]

A study is the same seed with slightly different prompts / modifiers. It's mainly used to understand the impact of a word/modifier on the final result. It must contains the resulting images

Modifiers

🔹 CFG modifier studies
🔹 Sampler studies
🔹 Iban's Image size animation study
🔹 ESoS' Image size study
🔹 ESoS' Steps & Sampler study
🔹 ESoS' CFG study
🔹 Chris Allen's CFG animated study
🔹 Localstarlight's CFG animated study (localstarlight#3529)
🔹 Captain's ETA/scale study (Captain#4568)
🔹 Captain's ETA/steps study (Captain#4568)
🔹 Bacontime's sampler animated study (bacontime#6072)
🔹 Muerilla's sampler/steps study, includes K-Diffusion
🔹 Muerilla's sampler study, includes K-Diffusion
🔹 Dolphin's Photo of Man sampler study (Dolphin#6313)
🔹 Sampler/steps w/ timing
🔹 Wonderflex's seeds study

Keywords

🔹 Fruit basket study (burnin#2452)
🔹 Park bench study (burnin#2452)
🔹 Camera study (Mr_Sumato#3369)
🔹 SD emojis study (Spake#1808)
🔹 4 Games Cafeteria study
🔹 Stylistic Lighting study
🔹 "Trending on Artstation" and other myths
🔹 "Trending on Artstation" and other myths (part 2)
🔹 Test of seeds, clothing, and clothing modifications
🔹 Wonderflex's photography terms studies

Other

🔹 Multilingual capabilities study
🔹 Stable Diffusion Prompt Weighting study
🔹 160 celebrities study
🔹 One Hundred TV shows study
🔹 Film studies
🔹 Punctuation study
🔹 Secondary artist study
🔹 Prompt permutation study
🔹 Artist order study (Kitt Hirasaki)

Art style/Artist lists [ToC]

🔹 Suburban House, Art styles
🔹 Stable Diffusion Artist Studies
🔹 SD Artist Collection (SGreen#2222)
🔹 Bacontime's Artist comparisons, part 1 (bacontime#6072)
🔹 Bacontime's Artist comparisons, part 2 (bacontime#6072)
🔹 SD Styles & Mediums
🔹 Anime Artist Styles (vibrantrida#4135)
🔹 52 Artists Collaborations
🔹 Manav Mashruwala's 1.5 Artist Studies

Keyword lists [ToC]

🔹 Artists, Keywords, Art styles known to work with text to image
🔹 Stable Diffusion prompting cheatsheet
🔹 Magicprompt
🔸 Offhand's Disco Diffusion Prompt Keywords

Misc [ToC]

🔹 Image dimension table (brbbbq#0731)
🔹 Image to prompt : CLIP Interrogator
🔹 Image to prompt (easy to use Replicate version): CLIP Interrogator
🔹 SD Image splitter
🔹 Dream Channel Backup - Prompts + modifiers + image links / Prompts + links / Prompts only / Raw CSV
🔹 SD Image Manager
🔹 SD Prompts to sqlite
🔹 SD Prompts + modifiers sqlite DB
🔹 SD Prompts/images search engine : Lexica, Libraire
🔹 UMAP Maps of CLIP ViT-L/14 keywords representations
🔹 Open Source code for running your own Stable Diffusion Discord bot
🔹 Ways to weight words : Emphasis study
🔹 1 week of SD
🔸 SD's Dataset search : CLIP retrieval
🔸 Tools and Resources for AI Art
🔸 3D Photo Inpainting Colab
🔸 Upscale Wiki Model Database - Upscalers are not exclusive to stable diffusion. However, their use is widespread, increasing the resolution of generated art.
🔸 Definitive Comparison to Upscalers (u/Locke_Moghan)
🔺 Camera distance terms

Prompts [ToC]

Here's a list of quick prompts to get you started in the world of Stable Diffusion

🔸 Rexwang8's Prompt Generator
🔸 AI Text Prompt Generator
🔸 Promptomania's Prompt Builder
🔸 Grammarly for Prompts (Chrome Extension)
🔹 GTA V cover character : [subject] in GTA V, cover art by Stephen Bliss, artstation
🔹 Quick photorealism (NOP#1337) : [prompt], Canon EOS R3, f/1.4, ISO 200, 1/160s, 8K, RAW, unedited, symmetrical balance, in-frame
🔹 Age changer (richservo#8465) : DSLR photo portrait still of [age] year old age [age] [person] at age [age]!!!, 85mm f1.8
🔹 Film character (richservo#8465) : film still of [character] [action] in [movie], 4k
🔹 Real life cartoon character (richservo#8465) : portrait photo still of real life [character], 8k, 85mm f1.8
🔹 Dish picture (richservo#8465) : DSLR food photograph of [dish description], 85mm f1.8
🔹 Muppet portrait (richservo#8465) : studio portrait still of muppet !!!!![person or character] !!!!!! as a muppet muppet as a muppet, 8k, studio lighting, key light -C 13 -s 150