You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/Using More GPUs.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,6 +7,8 @@ There are two primary ways to use more GPUs:
7
7
## More GPUs In Your Machine
8
8
9
9
To use more GPUs in your machine, simply add more self-start backends (interface -> `Server` -> `Backends`), and increment the `GPU_ID` setting for each added backend.
10
+
- Note, if you have mixed different GPUs, the IDs are not necessarily predictable, but they are consistent. Nvidia has acknowledged that the hardware order doesn't match the smi order: <https://forums.developer.nvidia.com/t/cuda-visible-devices-being-ignored/41808>*(This is annoying and I wish they'd fix it)*
11
+
- So, test what GPU is actually used for each ID by triggering generations on each backend and watching usage. It will be consistent as long as you don't change pcie hardware.
0 commit comments