Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature request: Provide better callback variables. #254

Open
tusharhero opened this issue Feb 28, 2025 · 0 comments
Open

feature request: Provide better callback variables. #254

tusharhero opened this issue Feb 28, 2025 · 0 comments

Comments

@tusharhero
Copy link

The current callback variable ellama-chat-done-callback, as the name
implies, only calls the function after it has finished processing the
entire response. This means there is no support for streaming
functionality. I have a text-to-speech function attached, but I need
to wait a long time before I can listen to the response due to this.

Additionally, in reasoning models, there is a lot of content within
the think block (which appears as a quote block in Org mode). It
must be determined whether we should treat this differently or add an
identifier to indicate that it is a "think" block. Having the option
to completely ignore such blocks when calling the callback function
would be ideal.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant