Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eval bug: Command A only outputs 88888888 with -fa #12441

Open
Azirine opened this issue Mar 18, 2025 · 0 comments
Open

Eval bug: Command A only outputs 88888888 with -fa #12441

Azirine opened this issue Mar 18, 2025 · 0 comments

Comments

@Azirine
Copy link

Azirine commented Mar 18, 2025

Name and Version

version: 4908 (a53f7f7)
built with Apple clang version 15.0.0 (clang-1500.3.9.4) for arm64-apple-darwin24.3.0

Operating systems

Mac

GGML backends

Metal

Hardware

M3 Max

Models

https://huggingface.co/bartowski/CohereForAI_c4ai-command-a-03-2025-GGUF/tree/main/CohereForAI_c4ai-command-a-03-2025-Q6_K
https://huggingface.co/lmstudio-community/c4ai-command-a-03-2025-GGUF/blob/main/c4ai-command-a-03-2025-Q6_K-00001-of-00003.gguf

Problem description & steps to reproduce

./llama-cli -m CohereForAI_c4ai-command-a-03-2025-Q6_K-00001-of-00003.gguf --no-mmap -fa -c 1024 -n 64 -if -no-cnv --in-prefix "<|START_OF_TURN_TOKEN|><|USER_TOKEN|>" --in-suffix "<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>"

First Bad Commit

No response

Relevant log output

== Running in interactive mode. ==
 - Press Ctrl+C to interject at any time.
 - Press Return to return control to the AI.
 - To return control without starting a new line, end your input with '/'.
 - If you want to submit another line, end your input with '\'.

<|START_OF_TURN_TOKEN|><|USER_TOKEN|>Hi
<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>8888888888888888888888888888888888888888888888888888888888888<|START_OF_TURN_TOKEN|><|USER_TOKEN|>
@Azirine Azirine changed the title Eval bug: Command A only outputs 88888888 Eval bug: Command A only outputs 88888888 with -fa Mar 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant