minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

docs(cookbook): port popular model usage guides into cookbook pages (#25813)

Browse Source 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
This commit is contained in:
Prabhu Prakash Kagitha
2026-06-01 17:41:49 -07:00
committed by GitHub
co-authored by Claude Sonnet 4.6 zijiexia Zijie Xia
parent 5e63200064
commit 98a1b58c47
47 changed files with 1262 additions and 2154 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs_new/docs/advanced_features/speculative_decoding.mdx
+1 -1
View File
@@ -401,7 +401,7 @@ print(response.choices[0].message.content)
## Multi Token Prediction
We support [MTP (Multi-Token Prediction)](https://arxiv.org/pdf/2404.19737) in SGLang by using speculative decoding. We use `XiaomiMiMo/MiMo-7B-RL` as an example here (for DeepSeek MTP usage, refer to [deepseek_v32 doc](../basic_usage/deepseek_v32#multi-token-prediction)).
We support [MTP (Multi-Token Prediction)](https://arxiv.org/pdf/2404.19737) in SGLang by using speculative decoding. We use `XiaomiMiMo/MiMo-7B-RL` as an example here (for DeepSeek MTP usage, refer to [DeepSeek-V3.2 cookbook §4.2.3](/cookbook/autoregressive/DeepSeek/DeepSeek-V3_2#4-2-3-multi-token-prediction-eagle-speculative-decoding)).
```bash Command
python3 -m sglang.launch_server \