You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardexpand all lines: docs/Prefill-decoding_Disaggregation.md
+1-1
Original file line number
Diff line number
Diff line change
@@ -46,4 +46,4 @@ Llumnix uses two simple arguments to enable prefill-decoding disaggregation in t
46
46
-`--enable-pd-disagg True` is used to enable prefill-decoding disaggregation.
47
47
-`--num-available-dispatch-instances` is used to configure the initial number of prefill instances.
48
48
49
-
Note that one should make sure that `num-available-dispatch-instances` is smaller than `initial_instance-num` (especially when `--enable-scaling` is not set), otherwise there would be no instances for decoding.
49
+
Note that one should make sure that `num-available-dispatch-instances` is smaller than `initial_instances` (especially when `--enable-scaling` is not set), otherwise there would be no instances for decoding.
0 commit comments