Liangsheng Yin
|
8020ea2ee9
|
[MLX] Drop a retracted request's runner state at its re-prefill (#43284)
|
2026-10-09 16:16:59 -07:00 |
|
Liangsheng Yin
|
f7e601b936
|
[MLX] Drain in-flight jobs before a retract-mode pause_generation (#43282)
|
2026-10-09 16:14:23 -07:00 |
|
 
|
f6c848c882
|
[PD] Use 1 to disable decode host receive and 0 for always-on (#43407)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: cctry <cctry@users.noreply.github.com>
|
2026-10-09 15:50:52 -07:00 |
|
Cheng Wan
|
58f6976ce7
|
[Fix] Unblock CUDA graph startup for hybrid parallelism (#43211)
|
2026-10-09 15:39:59 -07:00 |
|
 
|
cb9bd1d4d4
|
[Perf] Reduce multi-detokenizer router IPC sends (#42238)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-09 15:32:14 -07:00 |
|
 
|
66d840a8ef
|
[cuda_graph] Size dp-local decode graphs by the runner's own gather requirement (#43303)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: charlotte12l <charlotte12l@users.noreply.github.com>
|
2026-10-09 15:21:23 -07:00 |
|
 Kevin MiandClaude Opus 5.5
|
6d8ddaf1d7
|
[AMD] MiniMax-M3 indexer CP: packed scoring for EAGLE verify rows (#42614)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 15:05:50 -07:00 |
|
    
|
fbf8d730fd
|
[Fix] MiniMax-M3: default to the breakable prefill CUDA graph (#41845)
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 15:05:05 -07:00 |
|
 weireweireandweireweire
|
46c2585faa
|
[DSpark] Fold draft sampling for DeepSeek-V4.1 heads under AUTO (#42987)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-10-09 14:40:28 -07:00 |
|
Huabin
|
2f1acef3d8
|
[Model] Add LLaDA2.2 Block Routing MoE support (#31768)
|
2026-10-09 12:14:44 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
72eab59bf6
|
[GLM-5.3-Flash] Enable breakable prefill CUDA graph by default (#42845)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-10 02:41:02 +08:00 |
|
 
|
87845cda2b
|
[Multimodal] Chunk and cache audio items whose offsets span several placeholder runs (#43301)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: YavorGIvanov <YavorGIvanov@users.noreply.github.com>
|
2026-10-09 10:57:01 -07:00 |
|
 
|
3bffe69b74
|
[moe] Fill num_token_non_padded for the customized A2A backend at EP 1 (#43245)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: cctry <cctry@users.noreply.github.com>
|
2026-10-09 10:55:02 -07:00 |
|
 
|
3c612132fd
|
Overlap scheduler startup with the data parallel controller (#43177)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-10-09 10:54:22 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
5cbf949839
|
Fix torch.compile crash in fused gate-sigmoid-mul launcher (#43384)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-09 23:51:30 +08:00 |
|
 
|
76ccf0850c
|
[diffusion] fix: fix TeaCache CFG state lifecycle and skip boundaries (#42422)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-09 23:20:13 +08:00 |
|
 
|
121aa8dcc7
|
[diffusion] perf: fuse MiniMax-H3's RMSNorm and indexed AdaLN under quality lossless (#43327)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 22:39:11 +08:00 |
|
 
|
1203eb9181
|
[diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against attention over the copy engine (#43164)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 22:04:29 +08:00 |
|
xiaofei-zheng
|
fba3ad4b1f
|
[Frontend] Parallelize long chat prompt encoding (#41259)
|
2026-10-09 21:30:22 +08:00 |
|
xiaofei-zheng
|
db32673b78
|
[AMD] Let the GLM DSA NextN draft declare its own shared-expert fusion architecture (#41258)
|
2026-10-09 21:28:45 +08:00 |
|
xiaofei-zheng
|
d5c3ae9752
|
[AMD] Eliminate remaining gfx95 FP8 scale relayout copies (#41030)
|
2026-10-09 21:27:38 +08:00 |
|
   
|
78996e3f02
|
[Performance] Batch Mooncake hybrid-pool metadata and puts (#39696)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 21:12:42 +08:00 |
|
 
|
67d063f63b
|
[diffusion] feat: allow per-role attention backend override (#35310)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 20:57:29 +08:00 |
|
  
|
348689da40
|
[PP+PD] Fix #38206 Reduce bootstrap consensus latency (#38959)
Co-authored-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 20:53:48 +08:00 |
|
 
|
f1e0472fcc
|
[diffusion] model: support Wan-Animate-2 (#42941)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 20:46:23 +08:00 |
|
Shuwen Wang
|
0955169ed2
|
[mem_cache] Bound FlexKV checkpoint stores and restore DSPARK cache checks (#35694)
|
2026-10-09 20:25:33 +08:00 |
|
  
|
59eb71a831
|
[diffusion] fix: align SGLD CFG combine formula with diffusers Z-Image (#23772)
Co-authored-by: SGLang CI <ci@sglang.ai>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-09 19:47:03 +08:00 |
|
Shuwen Wang
|
f48ed2127e
|
test: allow bounded checkpoint lag in Mamba HiCache tests (#42523)
|
2026-10-09 19:24:39 +08:00 |
|
Xiaoyu Zhang
|
0eb24e7d5b
|
[Performance] Optimize Qwen3.8-Flash-Next BF16 decode on Blackwell (#42175)
|
2026-10-09 18:46:12 +08:00 |
|
 
|
516fd1c1b5
|
[diffusion] perf: tile MiniMax-H3's indexed modulation kernels by 2048 columns (#43267)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 18:23:52 +08:00 |
|
 vOvandXiaoyu Zhang
|
7cfecbef56
|
[diffusion][model] Add native SANA-Video 2.0 support (#41492)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-09 17:28:03 +08:00 |
|
DevashishLal-CB
|
4debae7534
|
Add blackwell dual gemm fusion support for MLP (#41887)
Signed-off-by: Devashish Lal <devcode@meta.com>
|
2026-10-09 17:26:33 +08:00 |
|
Thomas Wang
|
5eca4d8caf
|
[AMD] Set maxseq length limit for DSV4.1 BCG metadata buffers (#42570)
|
2026-10-09 02:15:43 -07:00 |
|
 Avaya AggarwalandMick Qian
|
d677848968
|
[diffusion] fix: fix CFG normalization to use per-sample norm instead of batch-flattened norm (#41706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:43:18 +08:00 |
|
 Murthy LandClaude Opus 5
|
3ab142adc4
|
[diffusion] feat: enable breakable CUDA graphs for FLUX.2 Klein (#36470)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-09 16:40:09 +08:00 |
|
 
|
b922f5ca20
|
[diffusion] fix: share the IPC all-to-all transport between AllToAll4D and USP (#43269)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 16:31:55 +08:00 |
|
 MickandMick Qian
|
17b2f35ae7
|
[diffusion] refactor: remove unused helpers and write-only state (#43064)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:30:55 +08:00 |
|
 James XuandMick Qian
|
ee4e2f7818
|
[diffusion] optimization: enable channels_last_3d for Cosmos3 VAE (#28021)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:29:46 +08:00 |
|
Cheng Wan
|
dc0b394471
|
[Refactor] Remove Kimi K3's own layer communication and let the consumer set an FFN's exit (#42936)
|
2026-10-09 01:27:46 -07:00 |
|
Cheng Wan
|
305ad5503d
|
[Refactor] Run Kimi K3's fused collectives through stage boundaries (#42898)
|
2026-10-09 01:27:23 -07:00 |
|
Cheng Wan
|
2b469040d2
|
[Refactor] Support attention-TP dense FFNs and unpadded batches on stage boundaries (#42897)
|
2026-10-09 01:27:00 -07:00 |
|
Cheng Wan
|
b9ae3d1a65
|
[Fix] Run attention on a padded extend batch's real rows (#42896)
|
2026-10-09 01:26:38 -07:00 |
|
Cheng Wan
|
7203747cc8
|
[Fix] Shard Kimi K3's shared experts over the TP group they sum over (#42895)
|
2026-10-09 01:26:15 -07:00 |
|
 MickandMick Qian
|
45ad463c87
|
[diffusion] refactor: deduplicate UniPC solvers and Gemma3 shard loading (#42899)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:26:04 +08:00 |
|
Cheng Wan
|
125f88cb75
|
[Refactor] Run Kimi K3 through stage boundaries (#42894)
|
2026-10-09 01:25:51 -07:00 |
|
Cheng Wan
|
666da4f56b
|
[Fix] Kimi K3 KDA value head size and SiTU input alignment (#42893)
|
2026-10-09 01:25:28 -07:00 |
|
Cheng Wan
|
48a6c0a5d0
|
[Fix] Return an FFN's output to the attention rows at a pipeline handoff (#42892)
|
2026-10-09 01:25:05 -07:00 |
|
Cheng Wan
|
b2402ccad6
|
[Fix] Merge DeepSeek-V4 two-batch-overlap microbatches without a residual (#42891)
|
2026-10-09 01:24:42 -07:00 |
|
 
|
37ae292e6f
|
[diffusion] fix: skip LTX-2 SP masks only for globally unpadded sequences (#43134)
Co-authored-by: yatholam <yatholam@amd.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 15:08:41 +08:00 |
|
 
|
e0608d890e
|
fix: use dp_size instead of attn_dp_size for msprobe rank id (#43041)
Co-authored-by: l30044004 <louyujing@huawei.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
|
2026-10-09 09:40:43 +03:00 |
|