[SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599)

Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2026-04-20 14:25:04 -07:00
parent dbcf7459b5
commit b65799cf83
13 changed files with 1296 additions and 33 deletions
@@ -45,6 +45,7 @@ Its core features include:
   advanced_features/hyperparameter_tuning.md
   advanced_features/attention_backend.md
   advanced_features/speculative_decoding.ipynb
+   advanced_features/adaptive_speculative_decoding.md
   advanced_features/structured_outputs.ipynb
   advanced_features/structured_outputs_for_reasoning_models.ipynb
   advanced_features/tool_parser.ipynb