sglang

cpp_ngram

Remove fields that are never used in spec/engine/disagg (#25434 )

2026-05-16 09:18:00 +08:00

triton_ops

[Spec] Remove dead prepare_for_verify / prepare_extend_after_decode + extend-decode kernel (#27761 )

2026-06-11 20:59:30 -07:00

adaptive_runtime_state.py

[Refactor] Cuda Graph Runner/Backend Refactor (#23906 )

2026-06-09 21:36:57 -07:00

adaptive_spec_params.py

[spec decoding] supports step 0 in adaptive spec decoding (updating draft kv cache without draft decoding) (#23994 )

2026-06-15 22:21:26 -07:00

base_spec_worker.py

[Bugfix] Fix MTP acceptance regression on plan stream by moving int64 cast before plan stream context (#28410 )

2026-06-22 01:26:58 +08:00

dflash_info_v2.py

[Feature] Spec V2 DFlash Support (#23000 )

2026-06-10 19:27:42 -07:00

dflash_info.py

refactor(runner): rename runner replay/load/can_run for the shared surface (#28384 )

2026-06-19 01:45:04 -07:00

dflash_utils.py

dflash add sliding window attention draft layer support (#27469 )

2026-06-14 00:32:02 -07:00

dflash_worker_v2.py

Revert "[Spec] Split init_backends; account draft weights in --mem-fraction-static" (#28841 )

2026-06-21 07:52:35 -07:00

draft_utils.py

[NPU] Add Ascend NPU support for DeepSeek-V4 (#25144 )

2026-06-18 15:30:25 +08:00

eagle_disaggregation.py

Allow custom speculative algorithm to support disaggregation (#26195 )

2026-05-27 09:54:53 -07:00

eagle_draft_cuda_graph_runner.py

[mtp] add rejection sampling for speculative decoding (#26312 )

2026-06-20 15:10:42 -07:00

eagle_draft_extend_cuda_graph_runner.py

[Spec] Enable FR-Spec in EAGLE draft-extend CUDA graph by sizing logits buffer from the draft head (#28856 )

2026-06-21 15:35:57 -07:00

eagle_info_v2.py

[Perf] Make spec-decode penalty H2D non-blocking and share decode cumulate path (#28500 )

2026-06-17 00:59:58 -07:00

eagle_info.py

[Spec] Support FlashInfer CUDA graph for EAGLE draft-extend (#28782 )

2026-06-21 14:46:25 -07:00

eagle_utils.py

[mtp] add rejection sampling for speculative decoding (#26312 )

2026-06-20 15:10:42 -07:00

eagle_worker_v2.py

[Spec] Enable FR-Spec in EAGLE draft-extend CUDA graph by sizing logits buffer from the draft head (#28856 )

2026-06-21 15:35:57 -07:00

external_corpus_manager.py

[Spec][Ngram] Return token counts in list_external_corpora API (#22471 )

2026-04-10 21:50:02 -07:00

frozen_kv_mtp_cuda_graph_runner.py

refactor(runner): rename runner replay/load/can_run for the shared surface (#28384 )

2026-06-19 01:45:04 -07:00

frozen_kv_mtp_info.py

[Spec] Clear dead DRAFT_EXTEND objects left after EAGLE v1 removal (#28133 )

2026-06-13 13:04:51 -07:00

frozen_kv_mtp_utils.py

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984 )

2026-06-11 17:38:05 -07:00

frozen_kv_mtp_worker_v2.py

Revert "[Spec] Split init_backends; account draft weights in --mem-fraction-static" (#28841 )

2026-06-21 07:52:35 -07:00

multi_layer_eagle_draft_extend_cuda_graph_runner.py

refactor(runner): rename runner replay/load/can_run for the shared surface (#28384 )

2026-06-19 01:45:04 -07:00

multi_layer_eagle_utils.py

[codex] Centralize Triton utility kernels (#26000 )

2026-06-02 16:47:45 +08:00

multi_layer_eagle_worker_v2.py

Revert "[Spec] Split init_backends; account draft weights in --mem-fraction-static" (#28841 )

2026-06-21 07:52:35 -07:00

ngram_info.py

[Spec] Move eagle verify prepare_for_verify/sample to eagle_utils free helpers (#28117 )

2026-06-12 20:37:33 -07:00

ngram_worker.py

[Spec] Move eagle verify prepare_for_verify/sample to eagle_utils free helpers (#28117 )

2026-06-12 20:37:33 -07:00

reject_sampling.py

[mtp] add rejection sampling for speculative decoding (#26312 )

2026-06-20 15:10:42 -07:00

spec_info.py

Custom spec algorithm can handle server args (#28162 )

2026-06-16 17:13:52 -07:00

spec_registry.py

Custom spec algorithm can handle server args (#28162 )

2026-06-16 17:13:52 -07:00

spec_utils.py

[mtp] add rejection sampling for speculative decoding (#26312 )

2026-06-20 15:10:42 -07:00

standalone_worker_v2.py

Revert "[Spec] Split init_backends; account draft weights in --mem-fraction-static" (#28841 )

2026-06-21 07:52:35 -07:00