-
-
Notifications
You must be signed in to change notification settings - Fork 112
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: App crush when try Load new model. PocketPal 1.6.0 (39) #140
Comments
OK., this maybe is a problem. Response from other source: "Falcon 3 is extremely new, its likely that llama.cpp simply doesn't support it yet. Will need to wait until this is added on their end. Closed for now." |
I had the same problem with LLama either 8B imported or ever since with all models, even offical small ones like Qwen (GitHub cut it early but basically it crash at the end) pocketpal-crash.mp4 |
Strange. If app crush sometimes show monit, and there is a button to see crush log, if you will try again and this show, you can copy and paste this log here, will be simple to find a bug. BTW. |
IDK what you are saying for sure, but Android doesn't detect any crash. I have Android 15 with Pixel 9. Llama 3 1B 4K does work, but I should be able to have 3B as I have 12GB of RAM. |
wrt Falcon3 we need to wait for llama.cpp to support it: ggerganov/llama.cpp#10883 |
Hi, thanks for sharing this app. Following this issue as I have the same phone, os, and app version. I get app crash when loading models:
I am able to load SmolLM2-1.7B Q4 successfully. Is this simply due to the age of my phone? Thanks, |
I also have the same model size. I don't understand what you meant 250mb. |
I mean due to automatic screen lock my download is stopped at 250mb, but the app shows like modal download was complete. When I delete old models, keep screen on during download it works as expected, no app crash now. It's working great. |
@Gopinathsgn Thanks for the hints! On the settings page, there is an option for Background Download. You can enable it using this option. Starting with the next release, it will be enabled by default. Additionally, just a reminder that a long-standing item is to implement a check to verify the file before loading it and we need to provide the user with an appropriate message if the model wasn't downloaded correctly. |
I don't think there was any issue with the download, at least I didn't quit before download is finished |
[Bug]: App crush when try Load new model. PocketPal 1.6.0 (39)
Model: Falcon3-1B-Instruct-GGUF
Phone: Pixel 6a
OS: GrapheneOS (Android 15)
I put 3 crush side by side, from 3 different app, when I try ADD or LOAD model.
Maybe will be simple find there a bug. Because model crush on all apps or maybe model is buggy.
Model: https://huggingface.co/tiiuae/Falcon3-1B-Instruct-GGUF/resolve/main/Falcon3-1B-Instruct-q4_k_m.gguf
PocketPal, Model : Added correctly? Yes. Load correctly? No.
App: PocketPal 1.6.0 (39)
Model Falcon3-1B-Instruct-GGUF from Hugging Face via on app downloader
SmolChat, Model : Added correctly? Yes. Load correctly? No.
App: SmolChat-v0.0.2
ChatterUI, Model : Added correctly? No. Load correctly? No.
App: ChatterUI v0.8.3-beta4
The text was updated successfully, but these errors were encountered: