[Issue]: Could not load torch

[Norgus]

Issue Description

> nvcc --version                                                                                                                                                               (autosd)
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Mon_Apr__3_17:16:06_PDT_2023
Cuda compilation tools, release 12.1, V12.1.105
Build cuda_12.1.r12.1/compiler.32688072_0

> pip show torch                                                                                                                                                                 (autosd)
Name: torch
Version: 2.0.0
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: [email protected]
License: BSD-3
Location: /home/norgus/.local/lib/python3.10/site-packages
Requires: filelock, jinja2, networkx, nvidia-cublas-cu11, nvidia-cuda-cupti-cu11, nvidia-cuda-nvrtc-cu11, nvidia-cuda-runtime-cu11, nvidia-cudnn-cu11, nvidia-cufft-cu11, nvidia-curand-cu11,nvidia-cusolver-cu11, nvidia-cusparse-cu11, nvidia-nccl-cu11, nvidia-nvtx-cu11, sympy, triton, typing-extensions
Required-by: encodec, suno-bark, torchaudio, triton

The error when I run webui.sh:

22:55:49-154774 INFO     nVidia toolkit detected
22:55:49-157605 ERROR    Could not load torch: /mnt/intel_nvme/envs/automatic/venv/lib/python3.10/site-packages/torch/lib/libtorch_global_deps.so: failed to map segment from shared object

Any more information I can provide?

I have tried deleting the venv directory to let it get reinstalled, but same result.
I have restarted the PC, same result.

Version Platform Description

OS: Garuda linux (a distribution of Arch linux)
GPU: Nvidia 3090

versions of things I think are relevant?
Python 3.10.10 on Linux
Version: def7a02 Wed Apr 26 16:08:56 2023 -0400

I didn't get far enough for the browser to come into it yet!

[vladmandic]

converting to discussion, perhaps community can help as this is torch installation issue, not issue with the repo.

[Norgus]

Thanks for moving this to discussions, I would really appreciate some guidance on things I can try to deal with this.
I tried updating the repo, uninstalling torch (pip uninstall torch) and reinstalling it, deletec the venv again for good measure, but no change in behaviour.

[vladmandic]

google search shows two most common issues are:

• problems with /tmp - possibly reboot to fix?
• problems with linux system limits - check output of ulimit -a

since you've mentioned you're using Garuda Linux, its quite possible it has some different/strange system defaults when it comes enforcing limits, like for example "no standard user should use more than xx gb of ram"

[Norgus]

I've had a few reboots since then without improvement in the situation, I tried checking the limits and they look pretty good I think?

╰─λ ulimit -a                                                                                       (autosd)
Maximum size of core files created                              (kB, -c) unlimited
Maximum size of a process’s data segment                        (kB, -d) unlimited
Control of maximum nice priority                                    (-e) 31
Maximum size of files created by the shell                      (kB, -f) unlimited
Maximum number of pending signals                                   (-i) 256392
Maximum size that may be locked into memory                     (kB, -l) unlimited
Maximum resident set size                                       (kB, -m) unlimited
Maximum number of open file descriptors                             (-n) 1048576
Maximum bytes in POSIX message queues                           (kB, -q) 800
Maximum realtime scheduling priority                                (-r) 98
Maximum stack size                                              (kB, -s) 8192
Maximum amount of CPU time in seconds                      (seconds, -t) unlimited
Maximum number of processes available to current user               (-u) 1048576
Maximum amount of virtual memory available to each process      (kB, -v) unlimited
Maximum contiguous realtime CPU time                                (-y) unlimited

fwiw I can run the upstream automatic1111 ok

[vladmandic]

Even latest A1111? It adopted my PR for upgrade to Torch 2 as well...

[Norgus]

Even with latest and torch 2

bash webui.sh                                                                                 (auto1111)

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye)
################################################################

################################################################
Running on norgus user
################################################################

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
Using TCMalloc: libtcmalloc.so.4
Python 3.10.10 (main, Mar  5 2023, 22:26:53) [GCC 12.2.1 20230201]
Commit hash: 5ab7f213bec2f816f9c5644becb32eb72c8ffb89
Installing requirements
Installing requirements 1 for Infinite-Zoom



Installing Installing onnxruntime-gpu...
Installing Installing opencv-python...
Installing Installing Pillow...
Installing Installing segmentation-refinement...
Installing Installing scikit-learn...


Installing sd-dynamic-prompts requirements.txt

Launching Web UI with arguments: --opt-sdp-attention --theme=dark --api --no-half-vae
No module 'xformers'. Proceeding without it.
ControlNet v1.1.130
ControlNet v1.1.130
Loading weights [df614cd3c2] from /mnt/intel_nvme/envs/auto1111/stable-diffusion-webui/models/Stable-diffusion/hassakuHentaiModel_hassakuv1.safetensors
Creating model from config: /mnt/intel_nvme/envs/auto1111/stable-diffusion-webui/configs/v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Applying scaled dot product cross attention optimization.
Textual inversion embeddings loaded(5): bad_prompt_version2-neg, badhandv4, By bad artist -neg, realisticvision-negative-embedding, Unspeakable-Horrors-Composition-4v
Model loaded in 1.7s (load weights from disk: 0.4s, create model: 0.3s, apply weights to model: 0.5s, apply half(): 0.2s, move model to device: 0.2s).
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 9.3s (import torch: 0.8s, import gradio: 0.7s, import ldm: 0.2s, other imports: 0.7s, list SD models: 0.1s, load scripts: 1.8s, load SD checkpoint: 1.7s, create ui: 1.0s, gradio launch: 2.1s).

I tried using the same conda environment I use for upstream to run this fork but I get the same error (I guess they do have distinct python venvs though)

[Norgus]

here's a representative image of me thinking about this problem generated using auto1111 😂

[vladmandic]

as a test, can you remove everything from installer.py inside function def set_environment():
just trying to rule out any differences since i cannot reproduce.

[Norgus]

I just tried changing it like so:

UUID=77bfa026-b124-4918-bcd0-e2b23766a140   /mnt/intel_nvme   ext4    defaults,exec,noatime                       0 0

then confirmed with:

>sudo systemctl daemon-reload
>sudo umount /dev/nvme1n1p1
>sudo mount /dev/nvme1n1p1
>mount | grep intel                                                                                                                                                               (base)
/dev/nvme0n1p1 on /mnt/intel_nvme type ext4 (rw,nosuid,nodev,noexec,noatime)

😭

[Norgus]

Never mind, I just realised I had the wrong device. what an idiot.

>sudo umount /mnt/intel_nvme                                                                                                                                                      (base)
>sudo mount /mnt/intel_nvme                                                                                                                                                       (base)
>mount | grep intel                                                                                                                                                               (base)
/dev/nvme0n1p1 on /mnt/intel_nvme type ext4 (rw,noatime)

time to try stable diffusion stuff again I think

[Norgus]

OK here's what I get after starting a new venv:

bash webui.sh                                                                                                                                                             (vladwebui)
Create and activate python venv
Launching launch.py...
17:37:36-998497 INFO     Starting SD.Next
17:37:37-000728 INFO     Python 3.10.11 on Linux
17:37:37-003665 DEBUG    Git 2.40.1
17:37:37-024868 INFO     Version: e0543e44 Wed May 3 19:15:18 2023 -0400
17:37:37-140731 INFO     Latest published version: ceaf757130adb61eaf282a48e60ba8f053f03a21 2023-05-05T15:02:35Z
17:37:37-141496 INFO     Setting environment tuning
17:37:37-142004 INFO     nVidia CUDA toolkit detected
17:37:37-195216 DEBUG    Package version found: torch 2.0.1+cu118
17:37:37-196072 DEBUG    Package version found: torchvision 0.15.2+cu118
17:37:37-196738 DEBUG    Package version found: torchaudio 2.0.2+cu118
17:37:37-869662 INFO     Torch 2.0.1+cu118
17:37:37-873445 INFO     Torch backend: nVidia CUDA 11.8 cuDNN 8700
17:37:37-881551 INFO     Torch detected GPU: NVIDIA GeForce RTX 3090 VRAM 24257 Arch (8, 6) Cores 82
17:37:37-882691 DEBUG    Package version found: tensorflow 2.12.0
17:37:37-883319 INFO     Verifying requirements
17:37:37-883991 DEBUG    Package version found: addict 2.4.0
17:37:37-884678 DEBUG    Package version found: aenum 3.1.12
17:37:37-885327 DEBUG    Package version found: aiohttp 3.8.4
17:37:37-885985 DEBUG    Package version found: anyio 3.6.2
17:37:37-886716 DEBUG    Package version found: appdirs 1.4.4
17:37:37-887354 DEBUG    Package version found: astunparse 1.6.3
17:37:37-888010 DEBUG    Package version found: basicsr 1.4.2
17:37:37-888645 DEBUG    Package version found: bitsandbytes 0.38.1
17:37:37-889284 DEBUG    Package version found: blendmodes 2022
17:37:37-890030 DEBUG    Package version found: clean-fid 0.1.35
17:37:37-890669 DEBUG    Package version found: easydev 0.12.1
17:37:37-891299 DEBUG    Package version found: extcolors 1.0.0
17:37:37-891927 DEBUG    Package version found: facexlib 0.3.0
17:37:37-892565 DEBUG    Package version found: filetype 1.2.0
17:37:37-893310 DEBUG    Package version found: font-roboto 0.0.1
17:37:37-893940 DEBUG    Package version found: fonts 0.0.3
17:37:37-894561 DEBUG    Package version found: future 0.18.3
17:37:37-895175 DEBUG    Package version found: gdown 4.7.1
17:37:37-895822 DEBUG    Package version found: gfpgan 1.3.8
17:37:37-896560 DEBUG    Package version found: GitPython 3.1.31
17:37:37-897192 DEBUG    Package version found: httpcore 0.17.0
17:37:37-897817 DEBUG    Package version found: inflection 0.5.1
17:37:37-898437 DEBUG    Package version found: jsonmerge 1.9.0
17:37:37-899068 DEBUG    Package version found: kornia 0.6.12
17:37:37-899805 DEBUG    Package version found: lark 1.1.5
17:37:37-900445 DEBUG    Package version found: lmdb 1.4.1
17:37:37-901065 DEBUG    Package version found: lpips 0.1.4
17:37:37-901687 DEBUG    Package version found: numpy 1.24.3
17:37:37-902320 DEBUG    Package version found: omegaconf 2.3.0
17:37:37-903081 DEBUG    Package version found: open-clip-torch 2.19.0
17:37:37-903757 DEBUG    Package version found: opencv-contrib-python 4.7.0.72
17:37:37-904389 DEBUG    Package version found: piexif 1.1.3
17:37:37-905009 DEBUG    Package version found: Pillow 9.5.0
17:37:37-905639 DEBUG    Package version found: psutil 5.9.5
17:37:37-906361 DEBUG    Package version found: pyyaml 6.0
17:37:37-906965 DEBUG    Package version found: realesrgan 0.3.0
17:37:37-907585 DEBUG    Package version found: requests 2.30.0
17:37:37-908209 DEBUG    Package version found: resize-right 0.0.2
17:37:37-908856 DEBUG    Package version found: rich 13.3.5
17:37:37-909589 DEBUG    Package version found: safetensors 0.3.1
17:37:37-910211 DEBUG    Package version found: scipy 1.10.1
17:37:37-910843 DEBUG    Package version found: tb_nightly 2.14.0a20230505
17:37:37-911483 DEBUG    Package version found: toml 0.10.2
17:37:37-912107 DEBUG    Package version found: torch 2.0.1+cu118
17:37:37-912944 DEBUG    Package version found: torchdiffeq 0.2.3
17:37:37-913586 DEBUG    Package version found: torchsde 0.2.5
17:37:37-914231 DEBUG    Package version found: torchvision 0.15.2+cu118
17:37:37-914866 DEBUG    Package version found: voluptuous 0.13.1
17:37:37-915498 DEBUG    Package version found: yapf 0.33.0
17:37:37-916244 DEBUG    Package version found: scikit-image 0.20.0
17:37:37-916880 DEBUG    Package version found: tqdm 4.65.0
17:37:37-917495 DEBUG    Package version found: accelerate 0.18.0
17:37:37-918122 DEBUG    Package version found: opencv-python 4.7.0.72
17:37:37-918750 DEBUG    Package version found: diffusers 0.16.1
17:37:37-919480 DEBUG    Package version found: einops 0.4.1
17:37:37-920099 DEBUG    Package version found: gradio 3.28.1
17:37:37-920713 DEBUG    Package version found: numexpr 2.8.4
17:37:37-921326 DEBUG    Package version found: pandas 1.5.3
17:37:37-921951 DEBUG    Package version found: protobuf 3.20.3
17:37:37-922695 DEBUG    Package version found: pytorch_lightning 1.9.4
17:37:37-923335 DEBUG    Package version found: transformers 4.26.1
17:37:37-923956 DEBUG    Package version found: timm 0.6.13
17:37:37-924580 DEBUG    Package version found: tomesd 0.1.2
17:37:37-925215 DEBUG    Package version found: urllib3 1.26.15
17:37:37-928945 DEBUG    Repository update time: Thu May  4 00:15:18 2023
17:37:37-929567 DEBUG    Previous setup time: Thu May  4 00:22:11 2023
17:37:37-930148 DEBUG    Extension version: Thu May  4 00:03:45 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:a1111-sd-webui-lycoris
17:37:37-930758 DEBUG    Extension version: Wed May  3 21:20:21 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:LDSR
17:37:37-931354 DEBUG    Extension version: Thu May  4 00:03:48 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:sd-webui-controlnet
17:37:37-931937 DEBUG    Extension version: Wed May  3 21:20:22 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:stable-diffusion-webui-rembg
17:37:37-932530 DEBUG    Extension version: Wed May  3 21:20:21 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:sd-extension-aesthetic-scorer
17:37:37-933098 DEBUG    Extension version: Thu May  4 00:19:33 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:Lora
17:37:37-933665 DEBUG    Extension version: Thu May  4 00:03:49 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:stable-diffusion-webui-images-browser
17:37:37-934241 DEBUG    Extension version: Wed May  3 21:20:21 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:sd-extension-steps-animation
17:37:37-934837 DEBUG    Extension version: Wed May  3 21:20:21 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:sd-extension-system-info
17:37:37-935423 DEBUG    Extension version: Wed May  3 21:20:21 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:clip-interrogator-ext
17:37:37-936011 DEBUG    Extension version: Wed May  3 21:20:32 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:SwinIR
17:37:37-936587 DEBUG    Extension version: Wed May  3 21:20:21 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:sd-dynamic-thresholding
17:37:37-937171 DEBUG    Extension version: Thu May  4 00:03:45 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:multidiffusion-upscaler-for-automatic1111
17:37:37-937755 DEBUG    Extension version: Wed Apr 26 17:44:20 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:prompt-bracket-checker
17:37:37-938329 DEBUG    Extension version: Wed May  3 21:20:32 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:ScuNET
17:37:37-938888 DEBUG    Extension version: Wed May  3 21:20:21 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:sd-webui-model-converter
17:37:37-939468 DEBUG    Extension version: Wed May  3 21:20:21 2023 /mnt/intel_nvme/envs/automatic/extensions-builtin:seed_travel
17:37:37-940059 DEBUG    Extension version: Thu May  4 00:22:10 2023 /mnt/intel_nvme/envs/automatic/extensions:a1111-sd-webui-tagcomplete
17:37:37-940619 DEBUG    Latest extensions time: Thu May  4 00:22:10 2023
17:37:37-941109 DEBUG    Timestamps: version:1683155718 setup:1683156131 extension:1683156130
17:37:37-941656 INFO     No changes detected: Quick launch active
17:37:37-942453 INFO     Running extension preloading
17:37:37-942960 INFO     Server arguments: ['--debug', '--ignore']
17:37:37-943477 DEBUG    Starting WebUI
17:37:37-948229 DEBUG    Memory used: 0.39 total: 62.71 Collected 0
No module 'xformers'. Proceeding without it.
╭──────────────────────────────────────────────────────────────────────────── Traceback (most recent call last) ────────────────────────────────────────────────────────────────────────────╮
│ /mnt/intel_nvme/envs/automatic/launch.py:141 in <module>                                                                                                                                  │
│                                                                                                                                                                                           │
│   140                                                                                                                                                                                     │
│ ❱ 141     instance = start_server(immediate=True, server=None)                                                                                                                            │
│   142     while True:                                                                                                                                                                     │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/launch.py:116 in start_server                                                                                                                              │
│                                                                                                                                                                                           │
│   115     server = importlib.util.module_from_spec(module_spec)                                                                                                                           │
│ ❱ 116     module_spec.loader.exec_module(server)                                                                                                                                          │
│   117     if args.test:                                                                                                                                                                   │
│ in exec_module:883                                                                                                                                                                        │
│ in _call_with_frames_removed:241                                                                                                                                                          │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/webui.py:34 in <module>                                                                                                                                    │
│                                                                                                                                                                                           │
│    33 import ldm.modules.encoders.modules # pylint: disable=W0611,C0411                                                                                                                   │
│ ❱  34 from modules import extra_networks, ui_extra_networks_checkpoints # pylint: disable=C041                                                                                            │
│    35 from modules import extra_networks_hypernet, ui_extra_networks_hypernets, ui_extra_netwo                                                                                            │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/modules/ui_extra_networks_checkpoints.py:5 in <module>                                                                                                     │
│                                                                                                                                                                                           │
│    4                                                                                                                                                                                      │
│ ❱  5 from modules import shared, ui_extra_networks, sd_models                                                                                                                             │
│    6                                                                                                                                                                                      │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/modules/ui_extra_networks.py:11 in <module>                                                                                                                │
│                                                                                                                                                                                           │
│    10 from modules import shared                                                                                                                                                          │
│ ❱  11 from modules.images import read_info_from_image                                                                                                                                     │
│    12 from modules.generation_parameters_copypaste import image_from_url_text                                                                                                             │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/modules/images.py:16 in <module>                                                                                                                           │
│                                                                                                                                                                                           │
│    15                                                                                                                                                                                     │
│ ❱  16 from modules import sd_samplers, shared, script_callbacks, errors                                                                                                                   │
│    17 from modules.shared import opts, log                                                                                                                                                │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/modules/sd_samplers.py:1 in <module>                                                                                                                       │
│                                                                                                                                                                                           │
│ ❱  1 from modules import sd_samplers_compvis, sd_samplers_kdiffusion, shared                                                                                                              │
│    2                                                                                                                                                                                      │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/modules/sd_samplers_kdiffusion.py:8 in <module>                                                                                                            │
│                                                                                                                                                                                           │
│     7     pass                                                                                                                                                                            │
│ ❱   8 import k_diffusion.sampling                                                                                                                                                         │
│     9 from modules import prompt_parser, devices, sd_samplers_common                                                                                                                      │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/repositories/k-diffusion/k_diffusion/__init__.py:1 in <module>                                                                                             │
│                                                                                                                                                                                           │
│ ❱ 1 from . import augmentation, config, evaluation, external, gns, layers, models, sampling,                                                                                              │
│   2 from .layers import Denoiser                                                                                                                                                          │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/repositories/k-diffusion/k_diffusion/evaluation.py:6 in <module>                                                                                           │
│                                                                                                                                                                                           │
│     5 from cleanfid.inception_torchscript import InceptionV3W                                                                                                                             │
│ ❱   6 import clip                                                                                                                                                                         │
│     7 from resize_right import resize                                                                                                                                                     │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
ModuleNotFoundError: No module named 'clip'

So it didn't manage to install clip?

[vladmandic]

Can you try to start it once again, no reinstall

[Norgus]

ended up with the same module not found for clip.

[vladmandic]

but it was installed without errors:

Installing package: git+https://github.com/openai/CLIP.git@d50d76daa670286dd6cacf3bcd80b5e4823fc8e1
can you do
venv/Scripts/activate
pip show clip

and if it fails, do

pip install git+https://github.com/openai/CLIP.git@d50d76daa670286dd6cacf3bcd80b5e4823fc8e1

[Norgus]

ok it was showing that clip was available but not working, so I started to get suspicious that the venv had just silently not activated.
It turns out that it wasn't (I think because the default shell in Garuda is fish...)
after looking about it seems that

source venv/bin/activate.fish

does the job. I did a 'pip install clip' and it works now.
I 'm very sorry my bizarre environment setup caused so much troubleshooting, I'll have to look into how to just set bash as the shell because I don't have the depth of understanding to deal with this stuff.

bash webui.sh                                                                                                                                                               (vladwebui)
Create and activate python venv
Launching launch.py...
20:28:41-438120 INFO     Starting SD.Next
20:28:41-440481 INFO     Python 3.10.11 on Linux
20:28:41-462977 INFO     Version: e0543e44 Wed May 3 19:15:18 2023 -0400
20:28:41-721128 INFO     Latest published version: f6898c9aec9c8b40b55de52e1bf1b4b83028897d 2023-05-05T17:40:53Z
20:28:41-721966 INFO     Setting environment tuning
20:28:41-722486 INFO     nVidia CUDA toolkit detected
20:28:42-436175 INFO     Torch 2.0.1+cu118
20:28:42-446721 INFO     Torch backend: nVidia CUDA 11.8 cuDNN 8700
20:28:42-455347 INFO     Torch detected GPU: NVIDIA GeForce RTX 3090 VRAM 24257 Arch (8, 6) Cores 82
20:28:42-456433 INFO     Verifying requirements
20:28:42-472094 INFO     No changes detected: Quick launch active
20:28:42-473030 INFO     Running extension preloading
20:28:42-473543 INFO     Server arguments: []
No module 'xformers'. Proceeding without it.
20:28:44-936341 INFO     Libraries loaded
20:28:44-949809 INFO     Available models: /mnt/intel_nvme/envs/automatic/models/Stable-diffusion 15
20:28:45-366640 ERROR    Module load: /mnt/intel_nvme/envs/automatic/extensions-builtin/clip-interrogator-ext/scripts/clip_interrogator_ext.py: ModuleNotFoundError
╭──────────────────────────────────────────────────────────────────────────── Traceback (most recent call last) ────────────────────────────────────────────────────────────────────────────╮
│ /mnt/intel_nvme/envs/automatic/modules/script_loading.py:10 in load_module                                                                                                                │
│                                                                                                                                                                                           │
│    9 │   try:                                                                                                                                                                             │
│ ❱ 10 │   │   module_spec.loader.exec_module(module)                                                                                                                                       │
│   11 │   except Exception as e:                                                                                                                                                           │
│ in exec_module:883                                                                                                                                                                        │
│ in _call_with_frames_removed:241                                                                                                                                                          │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/extensions-builtin/clip-interrogator-ext/scripts/clip_interrogator_ext.py:9 in <module>                                                                    │
│                                                                                                                                                                                           │
│     8                                                                                                                                                                                     │
│ ❱   9 import clip_interrogator                                                                                                                                                            │
│    10 from clip_interrogator import Config, Interrogator                                                                                                                                  │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
ModuleNotFoundError: No module named 'clip_interrogator'
ControlNet v1.1.133
ControlNet v1.1.133
Image Browser: send2trash is not installed. recycle bin cannot be used.
20:28:45-757296 ERROR    Module load: /mnt/intel_nvme/envs/automatic/extensions-builtin/stable-diffusion-webui-rembg/scripts/postprocessing_rembg.py: ModuleNotFoundError
╭──────────────────────────────────────────────────────────────────────────── Traceback (most recent call last) ────────────────────────────────────────────────────────────────────────────╮
│ /mnt/intel_nvme/envs/automatic/modules/script_loading.py:10 in load_module                                                                                                                │
│                                                                                                                                                                                           │
│    9 │   try:                                                                                                                                                                             │
│ ❱ 10 │   │   module_spec.loader.exec_module(module)                                                                                                                                       │
│   11 │   except Exception as e:                                                                                                                                                           │
│ in exec_module:883                                                                                                                                                                        │
│ in _call_with_frames_removed:241                                                                                                                                                          │
│                                                                                                                                                                                           │
│ /mnt/intel_nvme/envs/automatic/extensions-builtin/stable-diffusion-webui-rembg/scripts/postprocessing_rembg.py:5 in <module>                                                              │
│                                                                                                                                                                                           │
│    4 from modules.ui_components import FormRow                                                                                                                                            │
│ ❱  5 import rembg                                                                                                                                                                         │
│    6                                                                                                                                                                                      │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
ModuleNotFoundError: No module named 'rembg'
20:28:45-896975 INFO     Loading theme: black-orange
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
20:28:46-636503 INFO     Initializing middleware
Loading weights: /mnt/intel_nvme/envs/automatic/models/Stable-diffusion/braBeautifulRealistic_v40.safetensors ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.1/4.1 GB 0:00:00
20:28:47-884139 INFO     Creating model from config: /mnt/intel_nvme/envs/automatic/configs/v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
20:28:49-018326 INFO     Applying scaled dot product cross attention optimization
20:28:49-038892 INFO     Embeddings loaded: 0 []
20:28:49-043986 INFO     Model loaded in 2.4s (load=1.2s create=0.3s apply=0.4s vae=0.3s move=0.2s)
20:28:49-051355 INFO     Startup time: 6.6s (torch=1.5s gradio=0.7s libraries=0.3s scripts=0.8s opts onchange=0.1s ui=0.7s start=0.1s checkpoint=2.4s)
20:28:49-052396 INFO     Memory used: 4.52 total: 62.71

So I'm missing a couple of modules, maybe a 'pip install -r requirements.txt' will do the trick? The webui is working now, though.

[vladmandic]

did you do pip install clip? that's wrong, that's a bs (to be polite) sitting on pypi. you need to use pip install i quoted above.
its ok until you try to run interrogate on anything and then it will say clip.load is unknown.

and the rest seems that installer thinks its finished (it says "quick launch active"), but in reality it didn't finish installing requirements from those two extensions.

run with --upgrade to force.

[Norgus]

ah, I see. I've done 'pip uninstall clip' and run the specific install you pasted and now successfully got clip-1.0

is --upgrade intended for webui.sh COMMANDLINE_ARGS variable?

[vladmandic]

yup, that also works. or just use it as actual command line arg webui.sh --upgrade

[Norgus]

oh that is a beautiful error-free startup output!

bash webui.sh --upgrade                                                                                                                                                     (vladwebui)
Create and activate python venv
Launching launch.py...
20:58:04-951031 INFO     Starting SD.Next
20:58:04-953216 INFO     Python 3.10.11 on Linux
20:58:04-979453 INFO     Version: f6898c9a Fri May 5 13:40:53 2023 -0400
20:58:05-262109 INFO     Setting environment tuning
20:58:05-262887 INFO     nVidia CUDA toolkit detected
20:58:05-982736 INFO     Torch 2.0.1+cu118
20:58:05-994444 INFO     Torch backend: nVidia CUDA 11.8 cuDNN 8700
20:58:06-003784 INFO     Torch detected GPU: NVIDIA GeForce RTX 3090 VRAM 24257 Arch (8, 6) Cores 82
20:58:06-004982 INFO     Verifying requirements
20:58:06-019285 INFO     Running setup
20:58:06-020083 INFO     Installing packages
20:58:06-020828 INFO     Installing repositories
20:58:06-032489 INFO     Installing submodules
20:58:06-155244 INFO     Updating submodules
20:58:11-958684 INFO     Extensions enabled: ['a1111-sd-webui-lycoris', 'LDSR', 'sd-webui-controlnet', 'stable-diffusion-webui-rembg', 'sd-extension-aesthetic-scorer', 'Lora',
'stable-diffusion-webui-images-browser', 'sd-extension-steps-animation', 'sd-extension-system-info', 'clip-interrogator-ext', 'SwinIR', 'sd-dynamic-thresholding',
'multidiffusion-upscaler-for-automatic1111', 'prompt-bracket-checker', 'ScuNET', 'sd-webui-model-converter', 'seed_travel']
20:58:45-333839 INFO     Extensions enabled: ['a1111-sd-webui-tagcomplete']
20:58:45-691337 INFO     Updating Wiki
20:58:46-510501 INFO     Running extension preloading
20:58:46-511233 INFO     Server arguments: ['--upgrade']
No module 'xformers'. Proceeding without it.
20:58:49-041181 INFO     Libraries loaded
20:58:49-054843 INFO     Available models: /mnt/intel_nvme/envs/automatic/models/Stable-diffusion 15
ControlNet v1.1.138
ControlNet v1.1.138
20:59:07-930582 INFO     Loading theme: black-orange
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
20:59:08-877130 INFO     Local URL: http://127.0.0.1:7860/
20:59:08-877916 INFO     API Docs: http://127.0.0.1:7860/docs
20:59:08-878422 INFO     Initializing middleware
Loading weights: /mnt/intel_nvme/envs/automatic/models/Stable-diffusion/braBeautifulRealistic_v40.safetensors ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/4.1 GB -:--:--
20:59:09-062437 INFO     Creating model from config: /mnt/intel_nvme/envs/automatic/configs/v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
20:59:10-302346 INFO     Applying scaled dot product cross attention optimization
20:59:10-322953 INFO     Embeddings loaded: 0 []
20:59:10-328113 INFO     Model loaded in 1.4s (load=0.1s create=0.3s apply=0.5s vae=0.3s move=0.2s)
20:59:10-650963 INFO     Startup time: 24.1s (torch=1.4s gradio=0.6s libraries=0.4s scripts=18.7s opts onchange=0.1s ui=0.8s start=0.1s checkpoint=1.7s)
20:59:10-652502 INFO     Memory used: 3.55 total: 62.71

I think that happily ends this saga (unless you spot something I'm overlooking!)

[vladmandic]

beautiful :)

[Norgus]

thank you for all the help, battling through my stupidity