Skip to content

Commit

Permalink
fix'
Browse files Browse the repository at this point in the history
  • Loading branch information
KuilongCui committed Dec 18, 2024
1 parent 17ad9a5 commit 0ed8f3e
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/Arguments.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ usage: -m llumnix.entrypoints.vllm.api_server [-h]
[--last-stage-max-blocks LAST_STAGE_MAX_BLOCKS]
[--max-stages MAX_STAGES]
[--enable-pd-disagg]
[--engine-type ENGINE_TYPE]
[--instance-type ENGINE_TYPE]
[--log-request-timestamps]
```
Expand Down Expand Up @@ -189,7 +189,7 @@ usage: -m llumnix.entrypoints.vllm.api_server [-h]
`--enable-pd-disagg`
- Enable prefill decoding disaggregation.

`--engine-type`
`--instance-type`
- Engine types for llumlet.
- Possible choices: prefill, decode, no_constraints

Expand Down

0 comments on commit 0ed8f3e

Please sign in to comment.