You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The updated v0.0.3 release should fix the problem. It required me to sync the llama.cpp module with the upstream repository, which had integrated the features to support Falcon 3B. The PR ggerganov/llama.cpp#10883 has been merged in the master branch of llama.cpp.
Please confirm that the new release fixes the issue. We can close this issue then.
Model: Falcon3-3B-Instruct-abliterated-Q6_K_L
App: SmolChat-v0.0.3
Phone: Pixel 9 pro XL
OS: (Android 15)
https://huggingface.co/bartowski/Falcon3-3B-Instruct-abliterated-GGUF/blob/main/Falcon3-3B-Instruct-abliterated-Q6_K_L.gguf
downloaded then loaded in app. it began to copy then crashed.
anytime the app is loaded it crashes.
testing uninstall then re-install [uninstalling makes the app work again .now testing the model after a re-download, sadly it still crashes]
same with this one: https://huggingface.co/bartowski/Falcon3-3B-Instruct-abliterated-GGUF/blob/main/Falcon3-3B-Instruct-abliterated-IQ4_NL.gguf
The text was updated successfully, but these errors were encountered: