Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Doc] Update FAQ links in spec_decode.rst #9662

Merged
merged 3 commits into from
Nov 8, 2024
Merged

[Doc] Update FAQ links in spec_decode.rst #9662

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
eca0d21
[Doc] Move additional tips/notes to the top (#9647)
DarkLight1337 Oct 24, 2024
146bbd6
[Doc] Update FAQ links in spec_decode.rst
whyiug Oct 24, 2024
819048d
Merge branch 'main' into fix_faq_doc
DarkLight1337 Nov 8, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/source/models/spec_decode.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -182,7 +182,7 @@ speculative decoding, breaking down the guarantees into three key areas:
3. **vLLM Logprob Stability**
- vLLM does not currently guarantee stable token log probabilities (logprobs). This can result in different outputs for the
same request across runs. For more details, see the FAQ section
titled *Can the output of a prompt vary across runs in vLLM?* in the `FAQs <../serving/faq.rst>`_.
titled *Can the output of a prompt vary across runs in vLLM?* in the `FAQs <../serving/faq>`_.


**Conclusion**
Expand All @@ -197,7 +197,7 @@ can occur due to following factors:

**Mitigation Strategies**

For mitigation strategies, please refer to the FAQ entry *Can the output of a prompt vary across runs in vLLM?* in the `FAQs <../serving/faq.rst>`_.
For mitigation strategies, please refer to the FAQ entry *Can the output of a prompt vary across runs in vLLM?* in the `FAQs <../serving/faq>`_.

Resources for vLLM contributors
-------------------------------
Expand Down
Loading