Failed to allocate about 882.11 MiB vram on a video card which has more than 2G of free vram #2317
Unanswered
playgithub
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
PROBLEM
It failed to allocate about 882.11 MiB vram on a video card which has more than 2G of free vram.
What's the problem?
BTW it works for the medium model "ggml-medium-q5_0.bin".
LOGS
$ glxinfo -B name of display: :0 display: :0 screen: 0 direct rendering: Yes Memory info (GL_NVX_gpu_memory_info): Dedicated video memory: 4096 MB Total available memory: 4096 MB Currently available dedicated video memory: 2050 MB OpenGL vendor string: NVIDIA Corporation OpenGL renderer string: NVIDIA GeForce GTX 1650/PCIe/SSE2 OpenGL core profile version string: 4.6.0 NVIDIA 555.58.02 OpenGL core profile shading language version string: 4.60 NVIDIA OpenGL core profile context flags: (none) OpenGL core profile profile mask: core profile OpenGL version string: 4.6.0 NVIDIA 555.58.02 OpenGL shading language version string: 4.60 NVIDIA OpenGL context flags: (none) OpenGL profile mask: (none) OpenGL ES profile version string: OpenGL ES 3.2 NVIDIA 555.58.02 OpenGL ES profile shading language version string: OpenGL ES GLSL ES 3.20Beta Was this translation helpful? Give feedback.
All reactions