Skip to content

[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user #15263

[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user

[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user #15263

Annotations

2 warnings

This job succeeded