|
a0670b5ba3
|
[SPEC] feat: add adaptive speculative decoding metrics (#25940)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Jarrod Barnes <jbarnes850@gmail.com>
|
2026-06-01 13:53:30 -07:00 |
|
|
|
86afa21ca7
|
feat: optional caller-supplied mm_hashes on GenerateReqInput (#25300)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-06-01 20:04:37 +02:00 |
|
|
|
f6a5a1b59c
|
[RL+VLM] Avoid retokenization drift for pre-tokenized (token-id) VLM requests (#26555)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: root <root@slurm-h200-209-231.slurm-compute.tenant-slurm.svc.cluster.local>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-06-01 09:58:14 -07:00 |
|
|
Ke Bao
|
f59bbef841
|
Split SWA leaf to one window on insert (#26919)
|
2026-06-01 23:46:55 +08:00 |
|
|
Lukas HumbelandClaude Opus 4.7
|
d8a5a25c36
|
Refactor NIXL hicache. Add O_DIRECT support (#25173)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-01 17:28:53 +02:00 |
|
|
Ke Bao
|
693adabff7
|
Fix Mamba2Metadata dropping has_mamba_track_mask (#26877)
|
2026-06-01 22:03:59 +08:00 |
|
|
Bi Xue
|
6965fe0eec
|
[sgl] Window-aware LRU refresh for SWA prefix cache in unified cache (#26615)
|
2026-06-01 19:35:18 +08:00 |
|
|
Liangsheng Yin
|
1bff7a290f
|
Refactor EAGLE infer tests: shared fixture + kits + overlap matrix (#26871)
|
2026-06-01 03:55:01 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
bc36231d65
|
[KDA] Support KDA packed decode (#26586)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-01 16:52:01 +08:00 |
|
|
Ke Bao
|
cdd06011a1
|
Make unified tree SWA hicache tests faithful to write-through backup (#26870)
|
2026-06-01 16:08:57 +08:00 |
|
|
Lianmin Zheng
|
53b8378307
|
Fix weights_checker checksum for 0-dim tensors and multi-GPU (#26863)
|
2026-05-31 21:27:03 -07:00 |
|
|
liuxianglong17
|
3aaf8f115e
|
fix test cases failed in nightly pipeline (#26714)
|
2026-06-01 11:33:47 +08:00 |
|
|
Ke Bao
|
972fbf7711
|
Skip flaky mamba extra_buffer disagg test (#26838)
|
2026-05-31 15:59:03 +08:00 |
|
|
fzyzcjy
|
f220c72929
|
Add periodic KV-canary stats logging and kernel-run-counter health check (#26821)
|
2026-05-31 10:00:19 +08:00 |
|
|
fzyzcjy
|
7dd19ae3d8
|
Add a sliding-window-attention divergence reporter for the KV-canary (#26820)
|
2026-05-31 09:59:28 +08:00 |
|
|
fzyzcjy
|
ae9db7ff4b
|
Add the KV-canary perturb modes and PD-disaggregation e2e tests (#26819)
|
2026-05-31 09:59:09 +08:00 |
|
|
fzyzcjy
|
6be4b32d8d
|
Add token-id verification to the KV-canary (#26818)
|
2026-05-31 09:58:51 +08:00 |
|
|
fzyzcjy
|
0ca610a6df
|
Add real-data KV verification to the KV-canary (#26817)
|
2026-05-31 09:58:32 +08:00 |
|
|
fzyzcjy
|
cdee16e144
|
Add the KV-canary perturb framework for fault-injection self-tests (#26816)
|
2026-05-31 09:58:14 +08:00 |
|
|
fzyzcjy
|
678e73a9ee
|
Add a deterministic token oracle and production write-input assertion (#26815)
|
2026-05-31 09:57:43 +08:00 |
|
|
fzyzcjy
|
9c43c3719f
|
Support EAGLE speculative decoding in the KV-canary (#26813)
|
2026-05-31 09:57:01 +08:00 |
|
|
fzyzcjy
|
30a22cc360
|
Add a periodic full-radix-tree KV-canary sweep (#26812)
|
2026-05-31 09:56:42 +08:00 |
|
|
fzyzcjy
|
27eb139ef7
|
Add the KV-canary mock-model end-to-end test harness (#26811)
|
2026-05-31 09:56:00 +08:00 |
|
|
fzyzcjy
|
e188745ee0
|
Add KV-canary SWA + DeepSeek-V4 pool support (#26810)
|
2026-05-31 09:55:34 +08:00 |
|
|
fzyzcjy
|
9ecf314970
|
Add the KV-canary install API and forward-path wiring (#26809)
|
2026-05-31 09:55:03 +08:00 |
|
|
fzyzcjy
|
11391b2a1c
|
Add the KV-canary core: data layer, MHA KV-pool patcher, and per-forward runner (#26808)
|
2026-05-31 09:54:24 +08:00 |
|
|
fzyzcjy
|
ce647cbcfd
|
Add a SimplePhaseChecker for execution-phase assertions (#26803)
|
2026-05-31 09:51:39 +08:00 |
|
|
fzyzcjy
|
7f93952f79
|
Add a debug toggle for selectively reverting PR fixes (#26802)
|
2026-05-31 09:50:12 +08:00 |
|
|
|
b421e60eed
|
【NPU】【bugfix】fix server error when mtp unquant (#26389)
Co-authored-by: cen121212 <luochen23@huawei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2026-05-30 15:01:19 +03:00 |
|
|
Haichuan Hu
|
acd689b407
|
feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667)
Signed-off-by: Haichuan Hu <kaisennhu@gmail.com>
|
2026-05-30 02:19:50 -07:00 |
|
|
|
a952e9174f
|
[MLX] Support Qwen3.5 (dense) Model (#25754)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-05-30 17:05:02 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
0d9a2a9de3
|
[MoE Refactor] Migrate SM90 Cutlass W4A16 to MoeRunner (#26489)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-30 02:02:56 -07:00 |
|
|
Jimmy Shong
|
716e670d3d
|
[bugfix]: size CuteDSL MoE allgather buffers for the worst-case forward (#26696)
|
2026-05-30 00:27:20 -07:00 |
|
|
Zhangheng
|
7662210406
|
[UnifiedTree]: Support eviction priority (#26549)
|
2026-05-30 15:19:43 +08:00 |
|
|
Zhangheng
|
c048ebd10d
|
[Hicache]: skip flaky test (#26764)
|
2026-05-30 15:16:12 +08:00 |
|
|
Liangsheng Yin
|
1c79015434
|
Drop dead ScheduleBatch return_routed_experts/return_indexer_topk fields (#26760)
|
2026-05-29 23:16:09 -07:00 |
|
|
|
6f1c9fc77b
|
[RL] Fix crash when the reqs in a batch have a mix of return_routed_experts = True and False. (#26423)
Co-authored-by: root <root@slurm-h200-209-231.slurm-compute.tenant-slurm.svc.cluster.local>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-05-29 20:46:10 -07:00 |
|
|
Liangsheng Yin
|
1f850e67f2
|
[core] Fix crashes on the gpu_only spec_v2 path (#26738)
|
2026-05-29 19:12:03 -07:00 |
|
|
Erik Wijmans
|
95cd2fd29f
|
[lora] More efficient pinned memory (#20876)
|
2026-05-30 09:04:59 +09:00 |
|
|
Lianmin Zhengandcctry
|
4ff1296f5e
|
Optimize get load calls (/v1/loads) using shared-memory load snapshots (#26348)
Co-authored-by: cctry <cctry@meta.com>
|
2026-05-29 13:40:26 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
ff8ed7a302
|
[refactor] unify cuda-graph capture/replay across attention backends (#26665)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-29 12:46:42 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
ec075d8bc5
|
Fix DRAFT_EXTEND_V2 CG metadata: align test fixture and Triton with production seq_lens convention (#26651)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-05-29 02:46:45 -07:00 |
|
|
Zhangheng
|
eb5d4827e8
|
[UnifiedTree]: Split unified tree kl ci into multiple files to reduce GPU usage. (#26666)
|
2026-05-29 02:46:34 -07:00 |
|
|
Teng Ma
|
544f3039d5
|
[PD] Fix IB device validation for JSON mappings (#26114)
|
2026-05-29 16:44:49 +08:00 |
|
|
blzheng
|
a722b1a437
|
[CPU] fix incorrect index of b_ptr in fused_sigmoid_gating_delta_rule… (#26634)
|
2026-05-29 16:08:12 +08:00 |
|
|
|
3ecf2c76ad
|
[CPU] Add GPT-OSS model optimization for CPU (#16775)
Co-authored-by: mingfeima <mingfei.ma@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-05-29 16:05:26 +08:00 |
|
|
Niko Ma
|
4d1163e6a9
|
[PD][MoRI] Align hybrid state transfer with per-component schema (#26539)
|
2026-05-29 00:54:46 -07:00 |
|
|
Thomas Wang
|
6e9bd82714
|
[AMD][CI] Update v4 CI setting and move the task to main branch (#26662)
|
2026-05-29 00:12:40 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
08ec19872c
|
[HotFix][Ling 2.6] Fix HybridLinearAttn dispatcher for Ling-2.6 (#26474)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-29 14:50:15 +08:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
0fb0ea7aac
|
test: add trtllm_mha EAGLE-draft CG runner coverage (chain) (#26669)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-05-28 23:46:06 -07:00 |
|