 Xiaoyu ZhangandClaude Opus 5.5
|
329072d99a
|
[Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 08:55:47 +08:00 |
|
Yoray Zack
|
87ed1b9526
|
[4/N] elastic-ep: Scale at DP-attention replica granularity (#33728)
|
2026-10-15 01:17:01 +08:00 |
|
Yuwei An
|
23150f7ae0
|
[DSv4.1] Reduce sparse-prefill workspace padding (#43921)
|
2026-10-12 18:51:36 -07:00 |
|
Jinyan Yi
|
f006fb49ec
|
[NPU] Stabilize HiCache and registered CI tests (#43308)
|
2026-10-12 17:10:26 +08:00 |
|
 
|
d434ea444d
|
[DSV4.1] Reduce eager Engram extend preparation (#42159)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 21:31:55 -07:00 |
|
ChengYM
|
0d0be8fc98
|
[AMD][MORI] Add MORI EP V2 support (#40666)
|
2026-10-11 20:54:13 -07:00 |
|
Yuwei An
|
8b2aaf7060
|
[Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287)
|
2026-10-09 22:42:35 -07:00 |
|
 Yuwei AnandYuwei An
|
2d38934493
|
[DSv4.1] mxfp8 dispatch cache (#42156)
Co-authored-by: Yuwei An <yuwei.an@MacBook-Pro-yuweian.local>
|
2026-10-09 16:36:28 -07:00 |
|
Xiaoyu Zhang
|
0eb24e7d5b
|
[Performance] Optimize Qwen3.8-Flash-Next BF16 decode on Blackwell (#42175)
|
2026-10-09 18:46:12 +08:00 |
|
   
|
20d1f3f56a
|
[Scheduler] Refresh waiting requests' cached prefixes under FCFS-like policies with LRU eviction (#41593)
Signed-off-by: Pei Li <peili@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-08 17:05:04 -07:00 |
|
Liangsheng Yin
|
2e64740442
|
[CI] Avoid Hugging Face Hub API calls when the local model cache is complete (#43229)
|
2026-10-08 16:27:31 -07:00 |
|
 metamergebotandHanming Lu
|
0b658c12ff
|
[Bench][MoE] Deal the simulated round-robin experts evenly across EP ranks (#43188)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2026-10-08 15:01:16 -07:00 |
|
Liangsheng Yin
|
7b9c42cf49
|
[CI] Remove the unregistered chunked-prefill tests under test/manual (#43081)
|
2026-10-08 01:16:39 -07:00 |
|
Liangsheng Yin
|
1066decce6
|
[Scheduler] Replace extend_range with extend_end derived from prefix_len (#42822)
|
2026-10-07 16:07:16 -07:00 |
|
Liangsheng Yin
|
5349d3e9d2
|
[Scheduler] Derive prefix KV indices from last_node at allocation; drop Req.prefix_indices (#42825)
|
2026-10-07 16:03:09 -07:00 |
|
Yuwei An
|
620c76f25d
|
[DSV4.1] Add opt-in TRT-LLM sparse attention support (#41603)
|
2026-10-06 12:02:10 +08:00 |
|
Liangsheng Yin
|
f3fe753475
|
[misc] Rename SGLANG_OPT_SWA_RELEASE_LEAF_LOCK_AFTER_WINDOW to SGLANG_OPT_RELEASE_PREFILL_SWA (#42657)
|
2026-10-05 17:24:15 -07:00 |
|
Yanbin Jiang
|
749a89abd6
|
[LoRA] Reorganize kernels and add CODEOWNERS (#42299)
|
2026-10-03 13:43:40 -07:00 |
|
Liangsheng Yin
|
8a328e867b
|
[mem_cache] Rename the tree's request-level insert_req to checkpoint (#42202)
|
2026-10-02 14:42:35 -07:00 |
|
Liangsheng Yin
|
50be533d09
|
[mem_cache] Rename cache_unfinished_req to checkpoint_req and count cache hits only when a request finishes (#41520)
|
2026-10-01 21:41:45 -07:00 |
|
amd-danli103
|
9c3262d855
|
[AMD][DSV4] feat: enable PD-disagg with fp8 unified_kv on gfx950 (#39166)
|
2026-09-30 23:42:31 -07:00 |
|
Cheng Wan
|
a9c97c9f69
|
[Feature] Add --attn-dp-size and deprecate --enable-dp-attention (#41818)
|
2026-09-30 13:34:18 -07:00 |
|
Cheng Wan
|
499e86db98
|
[Refactor] Keep only the TP and PP groups on the model runner (#41813)
|
2026-09-30 13:27:31 -07:00 |
|
 Anupa SajikumarandMa Mingfei
|
2ff52e3ceb
|
[Intel][XPU]Enable chunked prefill scnearios for XPU with UT (#33804)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-29 13:28:25 +08:00 |
|
Xiaoyu Zhang
|
38ec649048
|
[Refactor] Restore logical kernel groups and test organization (#41243)
|
2026-09-26 12:30:44 +08:00 |
|
Olga Miroshnichenko
|
0e2aac500b
|
[ROCm][Perf] aiter: page-level KV view for gfx950 fp8 page-64 asm prefill (#36505)
|
2026-09-25 19:23:46 -07:00 |
|
Liangsheng Yin
|
516ab77619
|
[Test] Route all sgl-eval benchmarks through run_sgl_eval and deprecate run_eval (#41280)
|
2026-09-25 15:48:38 -07:00 |
|
Liangsheng Yin
|
f88572a57c
|
[Test] Add in-process sgl-eval adapter and move validated GSM8K tests to it (#41216)
|
2026-09-25 13:59:17 -07:00 |
|
Liangsheng Yin
|
f337f01b80
|
[Test] Remove dead eval modules and point GSM8K/MMLU docs to sgl-eval (#41215)
|
2026-09-25 12:50:31 -07:00 |
|
Yoray Zack
|
de123f38bb
|
[3/N] elastic-ep: Recapture decode CUDA graphs after scale-up (#33723)
|
2026-09-23 01:51:30 -07:00 |
|
ANSHUMAN TRIPATHY
|
eb5e8c84be
|
Speculative Decoding with NGRAM support for XPU (#31362)
|
2026-09-23 14:04:20 +08:00 |
|
Liangsheng Yin
|
78980a3b0b
|
[misc] Remove deprecated endpoints, env vars and aliases past two releases (#40795)
|
2026-09-22 18:14:45 -07:00 |
|
Cheng Wan
|
91c329cc86
|
Take the model config out of the parallel group build, and finish retiring the parallel getters (#40707)
|
2026-09-22 10:55:21 -07:00 |
|
 Dayananda VandClaude Opus 5
|
35eb7cf8d6
|
[Intel][XPU][KVCanary] Enable KV Canary on Intel XPU (#33520)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-22 09:19:01 +08:00 |
|
Cheng Wan
|
bccf691b22
|
Bringing the parallel runtime up becomes a phase, not a side effect (#40345)
|
2026-09-21 12:29:50 -07:00 |
|
Cheng Wan
|
970e946e4f
|
Retire the per-runner parallel record (#40343)
|
2026-09-21 12:26:40 -07:00 |
|
Cheng Wan
|
2d0e94e3a3
|
Check the topology identities where the layout is written, and build at the published widths (#40340)
|
2026-09-21 12:22:59 -07:00 |
|
HuangJi
|
2a0cb2f04e
|
[Diffusion][MiniMax-H3] Add SM120 Sage compute for SubBlock sparse attention (#40116)
|
2026-09-20 16:40:28 +08:00 |
|
Ke Bao
|
a8a4d86be9
|
Remove swa and mamba radix cache (#40313)
|
2026-09-20 16:16:27 +08:00 |
|
Liangsheng Yin
|
d507accadc
|
[Test] Drop dead and strictly-subsumed CI test registrations (#40264)
|
2026-09-18 17:49:13 -07:00 |
|
iridiumine
|
f86f60081d
|
[NPU] Adapt hicache for K3 hybrid models (#39415)
|
2026-09-18 14:48:20 +08:00 |
|
Jensen
|
3ce3b4969f
|
[NPU] Avoid repeated BF16 wo_a weight transposes in DeepSeek-V4 decode (#39919)
|
2026-09-18 09:10:43 +03:00 |
|
Cheng Wan
|
406c9c71d8
|
[Feature] Support BF16 and batch-invariant inference with DeepEP v2 (#38160)
|
2026-09-15 14:30:50 -07:00 |
|
Cheng Wan
|
fa663e7297
|
config: delete the redundant full stamp in initialize_model_parallel (#39202)
|
2026-09-12 17:27:21 -07:00 |
|
iridiumine
|
a984c78330
|
[NPU] Support DFlash speculative decoding for MiMo-V2.5-Pro (mxfp4) (#37565)
|
2026-09-12 11:59:23 +08:00 |
|
Miaomiao Jiang
|
690428b470
|
[XPU] Add xpu forward in Gemma3RMSNorm & Add test and benchmark for Gemma3RMSNorm (#36278)
|
2026-09-11 10:32:25 +08:00 |
|
 ANSHUMAN TRIPATHYandmingfeima
|
2adb2e8485
|
[XPU] Adapt device agnostic API usage (#32093)
Co-authored-by: mingfeima <mingfei.ma@intel.com>
|
2026-09-11 10:03:12 +08:00 |
|
   
|
1b77f498a0
|
[NVIDIA] Support flashinfer Mega Moe (#31470)
Co-authored-by: djns99 <40156487+djns99@users.noreply.github.com>
Co-authored-by: 云挚 <ningyunxiao.nyx@antgroup.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-09-10 00:22:47 -07:00 |
|
Cheng Wan
|
db272201a2
|
[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)
|
2026-09-08 16:42:12 -07:00 |
|
Anupa Sajikumar
|
91a45ea37e
|
[Intel][XPU][LoRA] Enable LoRA on Intel XPU (#30345)
|
2026-09-08 12:46:41 +08:00 |
|