Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support for android and enable opencl #4831

Open
belog2867 opened this issue Feb 15, 2025 · 0 comments
Open

support for android and enable opencl #4831

belog2867 opened this issue Feb 15, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@belog2867
Copy link

belog2867 commented Feb 15, 2025

Is your feature request related to a problem? Please describe.

Support for Android devices using termux.
I tried to compile llama.cpp for Android and enabled opencl(gpu acceleration), and I got a good result).
I now know two questions.
1.The tmp directory needs to be redirected to /data/data/com.termux/files/usr/tmp
2.Compile llama.cpp with opencl support(Adreno) enabled for Android.
Describe the solution you'd like

add android support
1.The tmp directory needs to be redirected to /data/data/com.termux/files/usr/tmp
2.Compile llama.cpp with opencl support(Adreno) enabled for Android.
Describe alternatives you've considered

Use the proot container, but it is difficult to enable gpu support and some performance will be lost.
Additional context

./loaclai 11:45AM INF Setting logging to info 11:45AM INF Starting LocalAI using 8 threads, with models path: /data/data/com.termux/files/home/models 11:45AM INF LocalAI version: v2.25.0 (07655c0) WARNING: /sys/class/drm does not exist on this system (likely the host system is a virtual machine or container with no graphics). Therefore, GPUInfo.GraphicsCards will be an empty array. 11:45AM FTL Error running the application error="failed basic startup tasks with error unable to create ImageDir: "mkdir /tmp/generated: permission denied""

@belog2867 belog2867 added the enhancement New feature or request label Feb 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant