tao
|
6e8f3e09dd
|
[Model Loader] Add InstantTensor loader support (#40453)
|
2026-10-09 23:01:59 -07:00 |
|
cctry
|
33f6b00f32
|
Clamp default decode CUDA graph max_bs to max_running_requests (#43172)
|
2026-10-09 22:54:32 -07:00 |
|
Yuwei An
|
8b2aaf7060
|
[Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287)
|
2026-10-09 22:42:35 -07:00 |
|
YAMY
|
17852cdfe8
|
[DSv4.1] Initialize the full-to-SWA mapping for request-window pools (#43165)
|
2026-10-09 22:39:26 -07:00 |
|
Frederik Gossen
|
3831e7e091
|
[diffusion] Z-Image: autotune the shared transformer block at both token scales (#35755)
|
2026-10-10 13:04:43 +08:00 |
|
 Raymond HuangandClaude Opus 5
|
aa79087017
|
[diffusion] fix: fail MiniMax-H3 quality="high" closed on substituted DiT weights (#34978)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-10 13:03:44 +08:00 |
|
 
|
ccae3b3639
|
[diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against cuDNN SDPA on Blackwell (#43373)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 12:58:30 +08:00 |
|
Shangming Cai
|
1814ece57f
|
[PP+PD] Harden PPConsensusStore: msgspec wire format, drop malformed messages (#43329)
|
2026-10-10 12:38:38 +08:00 |
|
cctry
|
20948cdcc6
|
[PD] Reclaim parked optimistic prefills when request slots are exhausted (#43442)
|
2026-10-09 20:31:24 -07:00 |
|
Liangsheng Yin
|
7d44269907
|
[MemCache] Fix the strict busy check on prefill-aware SWA and tidy small leftovers (#43474)
|
2026-10-09 20:27:27 -07:00 |
|
 
|
f2e9a2bed1
|
[unified memory pool] Allocate without transfer waits, pin floating SWA reservations, drop the HiCache startup asserts (#43206)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: ZYHowell <ZYHowell@users.noreply.github.com>
|
2026-10-09 20:19:30 -07:00 |
|
     
|
436d73ddda
|
[diffusion] model: support HunyuanImage-3.0-Instruct (#36311)
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: wes-lyu <294033513+wes-lyu@users.noreply.github.com>
Co-authored-by: Wes <its.wesley.lyu@gmail.com>
Co-authored-by: AuFlow <73925903+AuFlow@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-10 11:11:28 +08:00 |
|
 Benjamin TruongandXiaoyu Zhang
|
37678784c6
|
[Gemma4][Attention] Enable Gemma4 FA4 on SM90 with head-dim 512 support (#42019)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-10 10:40:19 +08:00 |
|
 
|
55a8dffc87
|
Skip the eager activation reserve in KV sizing on a capped Full prefill role (#43435)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-09 19:36:48 -07:00 |
|
 
|
a338b9858a
|
[PD] Receive decode KV into separate paged SWA host pools; let host-capable receivers own abort drain tracking (#43410)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: cctry <cctry@users.noreply.github.com>
|
2026-10-09 19:33:06 -07:00 |
|
 Vladislav NosivskoyandBBuf
|
2ff3e6dce1
|
[SM90] Use native block32 DeepGEMM for DeepSeek-V4.1 (#42604)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-10-10 10:29:42 +08:00 |
|
Liangsheng Yin
|
465253ef52
|
[Scheduler] Fix the deterministic-inference hang when a prefill chunk is shorter than its alignment (#43444)
|
2026-10-09 19:06:18 -07:00 |
|
 
|
78218194ad
|
perf(kda): rebalance MTP verify precompute and state synchronization (#42683)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-10 10:03:19 +08:00 |
|
Michael
|
37114afe20
|
[AMD][Fix] Saturate FP8 KV commits instead of reproducing e4m3fnuz NaN overflow (#42982)
|
2026-10-10 09:49:56 +08:00 |
|
 
|
5f94a45896
|
[srt] Allow mixed chunk prefill on the Full prefill CUDA graph backend (#43461)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-09 18:21:22 -07:00 |
|
 MickandMick Qian
|
cde16aa64d
|
[diffusion] model: support Qwen-Image 2.1 Turbo and checkpoint sampling grids (#43391)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-10 09:12:56 +08:00 |
|
 
|
e8fb52c526
|
[Fix] Keep request-pool row generations monotonic across clear() (#43439)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: colinchan15 <colinchan15@users.noreply.github.com>
|
2026-10-09 18:08:54 -07:00 |
|
ashwini rathi
|
8cf4d73c84
|
[XPU] Fix XPU CI breaks from #41105 (KDA chunk_offsets) and #42588 (int4 test tp_group) (#43334)
|
2026-10-10 09:06:24 +08:00 |
|
Avaya Aggarwal
|
66e6b68d82
|
[diffusion] comfyui: report the real runtime import error (#43178)
|
2026-10-10 09:05:12 +08:00 |
|
 
|
ff3aa58f11
|
[diffusion] perf: run MiniMax-H3's QK-norm + RoPE two rows per war while bit-identical (#43337)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 09:03:36 +08:00 |
|
 bookinstockandMick Qian
|
32f34e898b
|
[diffusion] fix: honor requested inference step count for MiniMax H3(#38671)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-10 09:02:57 +08:00 |
|
 
|
bd7c7971ba
|
[diffusion] perf: move MiniMax-H3's pipelined Ulysses copies off the SMs (#43361)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 08:58:07 +08:00 |
|
Alison Shao
|
9b37e28b83
|
Disable DualGemm fusion for Inkling dense MLP (#43447)
|
2026-10-09 17:56:20 -07:00 |
|
 
|
6acaf3374a
|
[kernel] SwiGLU-OAI MXFP8 producer; move swizzled MXFP8 producers to ops/quantization (#42810)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Denji-kk <51020465+Denji-kk@users.noreply.github.com>
|
2026-10-10 08:51:57 +08:00 |
|
Rain Jiang
|
961bcf481d
|
support DeepEP v2 on GLM-5.3 (#43432)
|
2026-10-09 16:57:12 -07:00 |
|
 Yuwei AnandYuwei An
|
2d38934493
|
[DSv4.1] mxfp8 dispatch cache (#42156)
Co-authored-by: Yuwei An <yuwei.an@MacBook-Pro-yuweian.local>
|
2026-10-09 16:36:28 -07:00 |
|
Liangsheng Yin
|
46498bc8c5
|
[MLX] Sync decode KV to the pool once at release, clamped to the owned prefix (#43292)
|
2026-10-09 16:20:45 -07:00 |
|
Liangsheng Yin
|
114cb44920
|
[MLX] Read radix prefix slots from the model runner's req_to_token pool (#43291)
|
2026-10-09 16:18:58 -07:00 |
|
Liangsheng Yin
|
8020ea2ee9
|
[MLX] Drop a retracted request's runner state at its re-prefill (#43284)
|
2026-10-09 16:16:59 -07:00 |
|
Liangsheng Yin
|
f7e601b936
|
[MLX] Drain in-flight jobs before a retract-mode pause_generation (#43282)
|
2026-10-09 16:14:23 -07:00 |
|
 
|
f6c848c882
|
[PD] Use 1 to disable decode host receive and 0 for always-on (#43407)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: cctry <cctry@users.noreply.github.com>
|
2026-10-09 15:50:52 -07:00 |
|
Cheng Wan
|
58f6976ce7
|
[Fix] Unblock CUDA graph startup for hybrid parallelism (#43211)
|
2026-10-09 15:39:59 -07:00 |
|
 
|
cb9bd1d4d4
|
[Perf] Reduce multi-detokenizer router IPC sends (#42238)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-09 15:32:14 -07:00 |
|
 
|
66d840a8ef
|
[cuda_graph] Size dp-local decode graphs by the runner's own gather requirement (#43303)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: charlotte12l <charlotte12l@users.noreply.github.com>
|
2026-10-09 15:21:23 -07:00 |
|
 Kevin MiandClaude Opus 5.5
|
6d8ddaf1d7
|
[AMD] MiniMax-M3 indexer CP: packed scoring for EAGLE verify rows (#42614)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 15:05:50 -07:00 |
|
    
|
fbf8d730fd
|
[Fix] MiniMax-M3: default to the breakable prefill CUDA graph (#41845)
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 15:05:05 -07:00 |
|
 weireweireandweireweire
|
46c2585faa
|
[DSpark] Fold draft sampling for DeepSeek-V4.1 heads under AUTO (#42987)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-10-09 14:40:28 -07:00 |
|
Huabin
|
2f1acef3d8
|
[Model] Add LLaDA2.2 Block Routing MoE support (#31768)
|
2026-10-09 12:14:44 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
72eab59bf6
|
[GLM-5.3-Flash] Enable breakable prefill CUDA graph by default (#42845)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-10 02:41:02 +08:00 |
|
 
|
87845cda2b
|
[Multimodal] Chunk and cache audio items whose offsets span several placeholder runs (#43301)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: YavorGIvanov <YavorGIvanov@users.noreply.github.com>
|
2026-10-09 10:57:01 -07:00 |
|
 
|
3bffe69b74
|
[moe] Fill num_token_non_padded for the customized A2A backend at EP 1 (#43245)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: cctry <cctry@users.noreply.github.com>
|
2026-10-09 10:55:02 -07:00 |
|
 
|
3c612132fd
|
Overlap scheduler startup with the data parallel controller (#43177)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-10-09 10:54:22 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
5cbf949839
|
Fix torch.compile crash in fused gate-sigmoid-mul launcher (#43384)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-09 23:51:30 +08:00 |
|
 
|
76ccf0850c
|
[diffusion] fix: fix TeaCache CFG state lifecycle and skip boundaries (#42422)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-09 23:20:13 +08:00 |
|
 
|
121aa8dcc7
|
[diffusion] perf: fuse MiniMax-H3's RMSNorm and indexed AdaLN under quality lossless (#43327)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 22:39:11 +08:00 |
|