You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
== Running in interactive mode. ==
- Press Ctrl+C to interject at any time.
- Press Return to return control to the AI.
- To return control without starting a new line, end your input with '/'.
- If you want to submit another line, end your input with '\'.
<|START_OF_TURN_TOKEN|><|USER_TOKEN|>Hi
<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>8888888888888888888888888888888888888888888888888888888888888<|START_OF_TURN_TOKEN|><|USER_TOKEN|>
The text was updated successfully, but these errors were encountered:
Name and Version
version: 4908 (a53f7f7)
built with Apple clang version 15.0.0 (clang-1500.3.9.4) for arm64-apple-darwin24.3.0
Operating systems
Mac
GGML backends
Metal
Hardware
M3 Max
Models
https://huggingface.co/bartowski/CohereForAI_c4ai-command-a-03-2025-GGUF/tree/main/CohereForAI_c4ai-command-a-03-2025-Q6_K
https://huggingface.co/lmstudio-community/c4ai-command-a-03-2025-GGUF/blob/main/c4ai-command-a-03-2025-Q6_K-00001-of-00003.gguf
Problem description & steps to reproduce
./llama-cli -m CohereForAI_c4ai-command-a-03-2025-Q6_K-00001-of-00003.gguf --no-mmap -fa -c 1024 -n 64 -if -no-cnv --in-prefix "<|START_OF_TURN_TOKEN|><|USER_TOKEN|>" --in-suffix "<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>"
First Bad Commit
No response
Relevant log output
The text was updated successfully, but these errors were encountered: