Skip to content

Commit

Permalink
[V1][Bugfix] Fix EngineCoreProc profile
Browse files Browse the repository at this point in the history
Signed-off-by: Tyler Michael Smith <[email protected]>
  • Loading branch information
tlrmchlsmth committed Dec 13, 2024
1 parent 0d8451c commit 177a1ea
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/v1/engine/core.py
Original file line number Diff line number Diff line change
Expand Up @@ -325,7 +325,7 @@ def _handle_client_request(
if isinstance(request, EngineCoreRequest):
self.add_request(request)
elif isinstance(request, EngineCoreProfile):
self.model_executor.worker.profile(request.is_start)
self.model_executor.profile(request.is_start)
else:
# TODO: make an EngineCoreAbort wrapper
assert isinstance(request, list)
Expand Down

0 comments on commit 177a1ea

Please sign in to comment.