weird ram usage.

[blenderman94]

good day im trying to understand how the math is works for kobold cpp.
i have a modell arraund 10gb in size with q3 quentiuation. i have my ram usage before trying to load as 6gb. i trying to understand the follwing. kobold says it will load lets say 8 gb to gpu and 2 gb to cpu but in the end it loads 8gb to gpu and take an other 10gb on cpu ram. what makes it kinda weird for me why? shuld it be just eating 2gb as it promised it will?

[LostRuins]

That's due to mmap, in future versions it will not be the default anymore.

[blenderman94]

i have this behaviour with both mmap enabled or disabled. it is something low level thing?

[LostRuins]

No, if mmap is disabled, when a layer is offloaded to GPU in cuda, it will be freed from RAM.

[blenderman94]

im using clbalst since i have no avx2 also i noticed that some models behavior is different when using cuda or clblast

[LostRuins]

Try the vulkan noavx2 version instead. Or use the cuda oldcpu exe.