 
|
0b1a73599a
|
[Feat] rust-server: Apply the x-override-* request headers (#44312)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 15:50:04 -07:00 |
|
William Hu
|
4e0609ea27
|
[Fix] moe: Preserve negative routing sentinel in EP mapping (#40498)
|
2026-10-15 15:05:08 -07:00 |
|
Yuwei An
|
91f6ef2322
|
[DSv4.1] Fuse request-window KV copies (#44555)
|
2026-10-15 14:11:51 -07:00 |
|
snadampal
|
aa5c7e887c
|
[Feat] docker: Add AWS EFA image variants built on published images (#41006)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
|
2026-10-15 13:19:22 -07:00 |
|
 Ziyi XuandClaude Opus 5.5
|
bc76a6b819
|
[DSv4] Sparse prefill: build compressed lengths without a host sync (#44557)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 12:45:56 -07:00 |
|
  
|
87211088c9
|
perf: fix overlap scheduling for NVIDIA Confidential Computing(CC) on Blackwell (#36810)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-15 12:09:09 -07:00 |
|
 
|
02a43eeef6
|
[Feat] rust-server: Attach configured metadata headers to a healthy /health_generate (#44315)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 12:04:23 -07:00 |
|
 
|
173e0f2e9b
|
[Feat] hicache: Add opt-in tail-only SWA backups in buffer mode (#44173)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-15 12:02:59 -07:00 |
|
 
|
c5a5bf0d0b
|
[Fix] pp: Order output send/recv by rank parity to fix cross-node hang (#44453)
Co-authored-by: chuixue <chuixue@minimaxi.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-16 01:46:37 +08:00 |
|
 Aleksi Vesantoandjacky.cheng
|
5ef8319f16
|
[Perf] [AMD] attention: Enable diffusion BF16 attention and MXFP4 compilation (#27702)
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-16 00:40:41 +08:00 |
|
YC Yen-Ching Tseng
|
e87e32b311
|
[Feat] [AMD] docker: Release ROCm 10.1 for gfx1250 in parallel with ROCm 10.0 (#42699)
|
2026-10-15 22:59:54 +08:00 |
|
qiaonan02
|
c4870d98cf
|
[Fix] glm5_next: Correct num_experts_per_tok default to 8 (#44093)
|
2026-10-15 21:53:31 +08:00 |
|
        
|
09b7383624
|
[diffusion] model: support FLUX.3 image (#44418)
Co-authored-by: Dom Brown <3886319+DomBrown@users.noreply.github.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Nikita Korobov <14355239+nekorobov@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-15 21:50:59 +08:00 |
|
 elvischenvandClaude Opus 5.5
|
6fe5596ebb
|
Support EPLB for Nemotron-H (#43685)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 13:50:09 +00:00 |
|
 ormandjandBenjamin Oldenburg
|
c5bf3aafbc
|
Fix overflow in legacy and v1 DSA top-k selectors (#37625)
Co-authored-by: Benjamin Oldenburg <benjamin.oldenburg@ordis.co.th>
|
2026-10-15 21:44:58 +08:00 |
|
 jiaqiang-dot-liuandCursor
|
2f5407da28
|
[Fix] [AMD] qwen3: Fix KV cache write in the fused QK-norm + mRoPE decode path (#44266)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-15 21:22:46 +08:00 |
|
sogalin_codegen
|
2092160d42
|
[AMD][Diffusion] Route unquantized linears through aiter tgemm on gfx1250 (#41988)
|
2026-10-15 21:08:44 +08:00 |
|
 Zhang Yiyang (SII)andMick Qian
|
23c2a026db
|
[diffusion] model: support MOSS-Image (#44325)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-15 19:23:56 +08:00 |
|
Cheng Wan
|
f7ad4345b8
|
[Refactor] deepseek-v4: Use explicit stage boundaries and row transport (#43607)
|
2026-10-15 02:05:28 -07:00 |
|
Cheng Wan
|
3a835cf417
|
[Refactor] inkling: Use short-convolution stage boundaries (#43606)
|
2026-10-15 02:04:46 -07:00 |
|
Cheng Wan
|
e1f9fce7b3
|
[Refactor] layer-boundary: Bind residual completion to producer updates (#43605)
|
2026-10-15 02:04:02 -07:00 |
|
Cheng Wan
|
d59c3448b0
|
[Fix] kimi-k3: Preserve pipeline graph bank inputs and bound chunk profiling (#43604)
|
2026-10-15 02:03:27 -07:00 |
|
 
|
93dbe88183
|
Fuse MiMo verification RoPE and KV cache writes (#43106)
Co-authored-by: lianghougong <lianghouhong@xiaohongshu.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-15 16:15:24 +08:00 |
|
  
|
86f4ede4fb
|
[Fix] dsa: Make the fused top-k exact on an overflowing threshold bin (#37941)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-15 15:52:48 +08:00 |
|
 
|
9ea5472833
|
[HiCache] Add the page_unified host KV layout and the unified L3 key (#39727)
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-10-15 15:46:13 +08:00 |
|
 
|
33618d4f00
|
[Feat] runtime: Include FlashInfer’s default tactic in startup tuning. (#43927)
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 15:30:45 +08:00 |
|
Liangsheng Yin
|
a776851c97
|
[Refactor] scheduler: Check the prefill budget at the admission loop head; drop a redundant PD gate (#44420)
|
2026-10-15 00:16:56 -07:00 |
|
 
|
fa66e7d816
|
[NPU] [Bugfix] Fix rope sin cos pre-calculation for Qwen3.5 during Pipeline Parallelism (#29753)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Артем Савкин <58187114+OrangeRedeng@users.noreply.github.com>
|
2026-10-15 09:58:47 +03:00 |
|
Dayuxiaoshui
|
a50c17e979
|
[diffusion] perf: fuse the Wan VAE conv bias epilogue and tile the RMSNorm+SiLU kernel (#38650)
|
2026-10-15 13:39:27 +08:00 |
|
   
|
676c038aa5
|
[diffusion] fix: fix the load duration missing from subclassed server tests (#40657)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-15 13:38:23 +08:00 |
|
Liangsheng Yin
|
f9bdb74a5a
|
[Fix] scheduler: Count a request's held req_to_token row once at admission (#44401)
|
2026-10-14 22:29:10 -07:00 |
|
Yuxingwang-intel
|
93842f52fe
|
[CPU]: Add group-aware CPU SHM collective kernels (#35435)
|
2026-10-15 13:22:20 +08:00 |
|
   
|
1d809bbbbd
|
[Fix] DSv4.1: Size the encoder-replay SWA pool by the DSpark draft's stages, and keep more prefix tails (#43502)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-10-14 22:04:58 -07:00 |
|
Khoa Pham
|
d4daf52369
|
[Fix] dsv41: Bound MoE routing to live SWA graph-tail rows (#44347)
|
2026-10-14 21:14:28 -07:00 |
|
 WenhaoZhangandMick
|
c92108bb93
|
[diffusion] comfyui: grouped SGLDOptions, native model loader and model-aware preflight (#44058)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-15 11:59:03 +08:00 |
|
Liangsheng Yin
|
3b5ae4ea86
|
[Fix] scheduler: Drop finished requests from the running batch before every admission (#44351)
|
2026-10-14 20:40:05 -07:00 |
|
 
|
2528cd2b91
|
[PD] Send DSA indexer state only past decode_prefix_len (#44140)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-15 11:25:18 +08:00 |
|
 Avaya Aggarwalandniehen6174
|
0cf683ea8d
|
[diffusion] comfyui: return several server-mode images as one IMAGE batch (#44088)
Co-authored-by: niehen6174 <1639206518@qq.com>
|
2026-10-15 10:38:37 +08:00 |
|
xiaofei-zheng
|
a12814c158
|
[Perf] [AMD] dsa: Enable the gfx950 fused DSA indexer for block-FP8 wq_b/wk (#43643)
|
2026-10-15 09:36:16 +08:00 |
|
 
|
9d68ecce2e
|
[DeepSeek-V4.1] DeepSelect cluster top-k for long rows and bf16 index logits (#44051)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-15 09:00:19 +08:00 |
|
xiaofei-zheng
|
c5c4bbbd25
|
[Perf] [AMD] dsa: Run DSA prefill under breakable CUDA graphs on HIP (#43642)
|
2026-10-15 08:59:34 +08:00 |
|
 Michaelandjacky.cheng
|
8333ccfccb
|
[Fix] [AMD] diffusion: Compare ReduceOp by identity so the compiled TP all-reduce stays one graph (#43770)
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-14 17:40:07 -07:00 |
|
Yuwei An
|
64a0a08f0a
|
[DSv4.1] Support TRT-LLM decoder bounded replay with BCG (#44326)
|
2026-10-14 17:39:52 -07:00 |
|
 YAMYandYuwei An
|
c891c5c7ca
|
[DSv4.1] Fold encoder-SWA replay into the extend forward (#43166)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-10-14 17:27:07 -07:00 |
|
Shuwen Wang
|
3c28614f12
|
[Fix] hicache: Defer query beliefs until the rank-synchronized hit drain (#43108)
|
2026-10-14 17:25:08 -07:00 |
|
 Aditya Singhandhnyls2002
|
a6a8c56015
|
[Fix] detokenizer router: Route by rid without tokenizer worker ipcs and broadcast logging config (#33715)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-14 17:20:21 -07:00 |
|
   
|
0536cec73d
|
[Feat] metrics: Expose multi-detokenizer router CPU usage (#43323)
Co-authored-by: raghul chandramouli <raghul@c1xind0180-0243.local>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-14 17:17:22 -07:00 |
|
 Junnan Liandhnyls2002
|
0f36c8015c
|
[Bug] Fix multi-tokenizer BatchEmbeddingOutput repack dropping fields (#31892)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-14 16:56:56 -07:00 |
|
 
|
209f8220d6
|
[Fix] sglang-server: Honour extra_key on the Rust frontend's /generate (#44207)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:44:31 -07:00 |
|
  
|
e7d6a88bfc
|
[HiCache] Buffer-only L3 for an auxiliary SWA window; load back only missing window rows (#43932)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: houseroad <houseroad@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-14 16:43:24 -07:00 |
|