Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enh: Expose ignore_eos_token option in generate requests #340

Merged
merged 4 commits into from
Mar 19, 2024

Conversation

jeffreyftang
Copy link
Contributor

@jeffreyftang jeffreyftang commented Mar 19, 2024

Closes #337

Screen Shot 2024-03-19 at 4 03 55 PM

@jeffreyftang jeffreyftang requested a review from tgaddair March 19, 2024 18:20
Copy link
Contributor

@tgaddair tgaddair left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add this to the python client as well?

Copy link
Contributor

@tgaddair tgaddair left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Expose ignore_eos_token on /generate and/or /v1/completions endpoints
2 participants