Add: ai-comic-factory forking tutorial (#1541)

* Add: ai-comic-factory forking tutorial * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Suggestion from Pedro * Update ai-comic-factory.md Co-authored-by: Pedro Cuenca <[email protected]> * Update ai-comic-factory.md Co-authored-by: Joshua Lochner <[email protected]> * Update ai-comic-factory.md * Update ai-comic-factory.md Co-authored-by: Joshua Lochner <[email protected]> * Update ai-comic-factory.md Co-authored-by: Joshua Lochner <[email protected]> --------- Co-authored-by: Pedro Cuenca <[email protected]> Co-authored-by: Joshua Lochner <[email protected]>
huggingface · Oct 2, 2023 · ef9aed0 · ef9aed0
1 parent e3a5ee4
commit ef9aed0
Show file tree

Hide file tree

Showing 3 changed files with 83 additions and 0 deletions.
diff --git a/_blog.yml b/_blog.yml
@@ -2923,3 +2923,15 @@
   date: September 29, 2023
   tags:
     - ethics
+
+- local: ai-comic-factory
+  title: "Deploying the AI Comic Factory using the Inference API"
+  author: jbilcke-hf
+  thumbnail: /blog/assets/165_ai_comic_factory/thumbnail.jpg
+  date: October 2, 2023
+  tags:
+    - guide
+    - inference
+    - api
+    - llm
+    - stable-diffusion
diff --git a/ai-comic-factory.md b/ai-comic-factory.md
@@ -0,0 +1,71 @@
+---
+title: "Deploying the AI Comic Factory using the Inference API"
+thumbnail: /blog/assets/165_ai_comic_factory/thumbnail.jpg
+authors:
+- user: jbilcke-hf
+---
+
+# Deploying the AI Comic Factory using the Inference API
+
+<!-- {blog_metadata} -->
+<!-- {authors} -->
+
+We recently announced [Inference for PROs](https://huggingface.co/blog/inference-pro), our new offering that makes larger models accessible to a broader audience. This opportunity opens up new possibilities for running end-user applications using Hugging Face as a platform.
+
+An example of such an application is the [AI Comic Factory](https://huggingface.co/spaces/jbilcke-hf/ai-comic-factory) - a Space that has proved incredibly popular. Thousands of users have tried it to create their own AI comic panels, fostering its own community of regular users. They share their creations, with some even opening pull requests.
+
+In this tutorial, we'll show you how to fork and configure the AI Comic Factory to avoid long wait times and deploy it to your own private space using the Inference API. It does not require strong technical skills, but some knowledge of APIs, environment variables and a general understanding of LLMs & Stable Diffusion are recommended.
+
+## Getting started
+
+
+First, ensure that you sign up for a [PRO Hugging Face account](https://huggingface.co/subscribe/pro), as this will grant you access to the Llama-2 and SDXL models.
+
+## How the AI Comic Factory works
+
+The AI Comic Factory is a bit different from other Spaces running on Hugging Face: it is a NextJS application, deployed using Docker, and is based on a client-server approach, requiring two APIs to work:
+
+- a Language Model API (Currently [Llama-2](https://huggingface.co/docs/transformers/model_doc/llama2))
+- a Stable Diffusion API (currently [SDXL 1.0](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion/stable_diffusion_xl))
+
+## Duplicating the Space
+
+To duplicate the AI Comic Factory, go to the Space and [click on "Duplicate"](https://huggingface.co/spaces/jbilcke-hf/ai-comic-factory?duplicate=true):
+
+![duplicate-space-1.jpg](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/165_ai_comic_factory/duplicate-space-1.jpg)
+
+You'll observe that the Space owner, name, and visibility are already filled in for you, so you can leave those values as is.
+
+Your copy of the Space will run inside a Docker container that doesn't require many resources, so you can use the smallest instance. The official AI Comic Factory Space utilizes a bigger CPU instance, as it caters to a large user base.
+
+To operate the AI Comic Factory under your account, you need to configure your Hugging Face token:
+
+![duplicate-space-2.jpg](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/165_ai_comic_factory/duplicate-space-2.jpg)
+
+## Selecting the LLM and SD engines
+
+The AI Comic Factory supports various backend engines, which can be configured using two environment variables:
+ - `LLM_ENGINE` to configure the language model (possible values are `INFERENCE_API`, `INFERENCE_ENDPOINT`, `OPENAI`)
+ - `RENDERING_ENGINE` to configure the image generation engine (possible values are `INFERENCE_API`, `INFERENCE_ENDPOINT`, `REPLICATE`, `VIDEOCHAIN`).
+
+We'll focus on making the AI Comic Factory work on the Inference API, so they both need to be set to `INFERENCE_API`:
+
+![duplicate-space-3.jpg](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/165_ai_comic_factory/duplicate-space-3.jpg)
+
+You can find more information about alternative engines and vendors in the project's [README](https://huggingface.co/spaces/jbilcke-hf/ai-comic-factory/blob/main/README.md) and the [.env](https://huggingface.co/spaces/jbilcke-hf/ai-comic-factory/blob/main/README.md) config file.
+
+## Configuring the models
+
+The AI Comic Factory comes with the following models pre-configured:
+- `LLM_HF_INFERENCE_API_MODEL`: default value is `meta-llama/Llama-2-70b-chat-hf`
+- `RENDERING_HF_RENDERING_INFERENCE_API_MODEL`: default value is `stabilityai/stable-diffusion-xl-base-1.0`
+
+Your PRO Hugging Face account already gives you access to those models, so you don't have anything to do or change.
+
+## Going further
+
+Support for the Inference API in the AI Comic Factory is in its early stages, and some features, such as using the refiner step for SDXL or implementing upscaling, haven't been ported over yet.
+
+Nonetheless, we hope this information will enable you to start forking and tweaking the AI Comic Factory to suit your requirements.
+
+Feel free to experiment and try other models from the community, and happy hacking!
diff --git a/assets/165_ai_comic_factory/thumbnail.jpg b/assets/165_ai_comic_factory/thumbnail.jpg