Control Vectors

[acidbubbles]

There is hype right now for control vectors. It looks like an interesting way to "steer" the LLM without relying on prompting, saving tokens and increasing instructions strength.

Read more on this on these implementations:

• llama.cpp: Add support for control vectors ggerganov/llama.cpp#5970
• oobabooga: https://github.com/Hellisotherpeople/llm_steer-oobabooga?tab=readme-ov-file