Skip to content

[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user #10280

[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user

[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user #10280

Annotations

2 warnings

This job succeeded