Skip to content

Commit

Permalink
Warn for unimplemented structured outputs reasoner
Browse files Browse the repository at this point in the history
Signed-off-by: Alex-Brooks <[email protected]>
  • Loading branch information
alex-jw-brooks committed Mar 6, 2025
1 parent 4ecb169 commit ecadd2d
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions vllm/model_executor/guided_decoding/reasoner/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ def get_reasoner(tokenizer: PreTrainedTokenizer,
return None
elif reasoning_backend == "deepseek_r1":
return DeepSeekReasoner.from_tokenizer(tokenizer)
elif reasoning_backend == "granite":
logger.warning(
"Granite reasoner not yet implemented for structured outputs")
return None
else:
# Raise a warning for unknown reasoning backend and return None
# We cannot raise an error here because some reasoning models
Expand Down

0 comments on commit ecadd2d

Please sign in to comment.