You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Support for Android devices using termux.
I tried to compile llama.cpp for Android and enabled opencl(gpu acceleration), and I got a good result).
I now know two questions.
1.The tmp directory needs to be redirected to /data/data/com.termux/files/usr/tmp
2.Compile llama.cpp with opencl support(Adreno) enabled for Android. Describe the solution you'd like
add android support
1.The tmp directory needs to be redirected to /data/data/com.termux/files/usr/tmp
2.Compile llama.cpp with opencl support(Adreno) enabled for Android. Describe alternatives you've considered
Use the proot container, but it is difficult to enable gpu support and some performance will be lost. Additional context
./loaclai 11:45AM INF Setting logging to info 11:45AM INF Starting LocalAI using 8 threads, with models path: /data/data/com.termux/files/home/models 11:45AM INF LocalAI version: v2.25.0 (07655c0) WARNING: /sys/class/drm does not exist on this system (likely the host system is a virtual machine or container with no graphics). Therefore, GPUInfo.GraphicsCards will be an empty array. 11:45AM FTL Error running the application error="failed basic startup tasks with error unable to create ImageDir: "mkdir /tmp/generated: permission denied""
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Support for Android devices using termux.
I tried to compile llama.cpp for Android and enabled opencl(gpu acceleration), and I got a good result).
I now know two questions.
1.The tmp directory needs to be redirected to /data/data/com.termux/files/usr/tmp
2.Compile llama.cpp with opencl support(Adreno) enabled for Android.
Describe the solution you'd like
add android support
1.The tmp directory needs to be redirected to /data/data/com.termux/files/usr/tmp
2.Compile llama.cpp with opencl support(Adreno) enabled for Android.
Describe alternatives you've considered
Use the proot container, but it is difficult to enable gpu support and some performance will be lost.
Additional context
./loaclai 11:45AM INF Setting logging to info 11:45AM INF Starting LocalAI using 8 threads, with models path: /data/data/com.termux/files/home/models 11:45AM INF LocalAI version: v2.25.0 (07655c0) WARNING: /sys/class/drm does not exist on this system (likely the host system is a virtual machine or container with no graphics). Therefore, GPUInfo.GraphicsCards will be an empty array. 11:45AM FTL Error running the application error="failed basic startup tasks with error unable to create ImageDir: "mkdir /tmp/generated: permission denied""
The text was updated successfully, but these errors were encountered: