Skip to content

Commit

Permalink
Correct type hint
Browse files Browse the repository at this point in the history
  • Loading branch information
gshtras authored Sep 9, 2024
1 parent b3fc9f4 commit 68eef6a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/engine/llm_engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -1394,7 +1394,7 @@ def _process_model_outputs(self, ctx: SchedulerContext) -> None:
return None

def _advance_to_next_step(
self, output: List[SamplerOutput],
self, output: SamplerOutput,
seq_group_metadata_list: List[SequenceGroupMetadata],
scheduled_seq_groups: List[ScheduledSequenceGroup]) -> None:
"""Given model output from a single run, append the tokens to the
Expand Down

0 comments on commit 68eef6a

Please sign in to comment.