Skip to content

Commit

Permalink
[Misc] Fix typos in spec. decode metrics logging. (vllm-project#6470)
Browse files Browse the repository at this point in the history
Signed-off-by: Thomas Parnell <[email protected]>
Signed-off-by: Alvant <[email protected]>
  • Loading branch information
tdoublep authored and Alvant committed Oct 26, 2024
1 parent c4de1a2 commit cbd5d55
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions vllm/engine/metrics.py
Original file line number Diff line number Diff line change
Expand Up @@ -325,8 +325,8 @@ def _format_spec_decode_metrics_str(
f"System efficiency: {metrics.system_efficiency:.3f}, "
f"Number of speculative tokens: {metrics.num_spec_tokens}, "
f"Number of accepted tokens: {metrics.accepted_tokens}, "
f"Number of draft tokens tokens: {metrics.draft_tokens}, "
f"Number of emitted tokens tokens: {metrics.emitted_tokens}.")
f"Number of draft tokens: {metrics.draft_tokens}, "
f"Number of emitted tokens: {metrics.emitted_tokens}.")


class PrometheusStatLogger(StatLoggerBase):
Expand Down Expand Up @@ -457,4 +457,4 @@ def log(self, stats: Stats):

class RayPrometheusStatLogger(PrometheusStatLogger):
"""RayPrometheusStatLogger uses Ray metrics instead."""
_metrics_cls = RayMetrics
_metrics_cls = RayMetrics

0 comments on commit cbd5d55

Please sign in to comment.