minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Fix ngram doc for speculative_num_draft_tokens default (#21910)

Browse Source
This commit is contained in:
Liangsheng Yin
2026-04-01 22:18:24 -07:00
committed by GitHub
parent f836658077
commit f25bf86065
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/advanced_features/speculative_decoding.md
+1 -1
View File
@@ -387,7 +387,7 @@ Enable it with:
| Parameter | Description | Default |
|---|---|---|
| `--speculative-num-draft-tokens` | Number of draft tokens verified per step. If omitted, defaults to `min(--speculative-ngram-max-trie-depth, 12)`. | `12` (with default ngram settings) |
| `--speculative-num-draft-tokens` | Number of draft tokens verified per step. | `12` |
| `--speculative-ngram-min-bfs-breadth` | Minimum BFS breadth. | `1` |
| `--speculative-ngram-max-bfs-breadth` | Maximum BFS breadth. | `10` |
| `--speculative-ngram-match-type` | Ngram tree-building mode: `"BFS"` for recency-based expansion or `"PROB"` for frequency-based expansion. | `"BFS"` |