Shuwen Wang
|
f48ed2127e
|
test: allow bounded checkpoint lag in Mamba HiCache tests (#42523)
|
2026-10-09 19:24:39 +08:00 |
|
Xiaoyu Zhang
|
0eb24e7d5b
|
[Performance] Optimize Qwen3.8-Flash-Next BF16 decode on Blackwell (#42175)
|
2026-10-09 18:46:12 +08:00 |
|
 
|
516fd1c1b5
|
[diffusion] perf: tile MiniMax-H3's indexed modulation kernels by 2048 columns (#43267)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 18:23:52 +08:00 |
|
 vOvandXiaoyu Zhang
|
7cfecbef56
|
[diffusion][model] Add native SANA-Video 2.0 support (#41492)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-09 17:28:03 +08:00 |
|
DevashishLal-CB
|
4debae7534
|
Add blackwell dual gemm fusion support for MLP (#41887)
Signed-off-by: Devashish Lal <devcode@meta.com>
|
2026-10-09 17:26:33 +08:00 |
|
Thomas Wang
|
5eca4d8caf
|
[AMD] Set maxseq length limit for DSV4.1 BCG metadata buffers (#42570)
|
2026-10-09 02:15:43 -07:00 |
|
 Avaya AggarwalandMick Qian
|
d677848968
|
[diffusion] fix: fix CFG normalization to use per-sample norm instead of batch-flattened norm (#41706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:43:18 +08:00 |
|
 Murthy LandClaude Opus 5
|
3ab142adc4
|
[diffusion] feat: enable breakable CUDA graphs for FLUX.2 Klein (#36470)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-09 16:40:09 +08:00 |
|
 
|
b922f5ca20
|
[diffusion] fix: share the IPC all-to-all transport between AllToAll4D and USP (#43269)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 16:31:55 +08:00 |
|
 MickandMick Qian
|
17b2f35ae7
|
[diffusion] refactor: remove unused helpers and write-only state (#43064)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:30:55 +08:00 |
|
 James XuandMick Qian
|
ee4e2f7818
|
[diffusion] optimization: enable channels_last_3d for Cosmos3 VAE (#28021)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:29:46 +08:00 |
|
Cheng Wan
|
dc0b394471
|
[Refactor] Remove Kimi K3's own layer communication and let the consumer set an FFN's exit (#42936)
|
2026-10-09 01:27:46 -07:00 |
|
Cheng Wan
|
305ad5503d
|
[Refactor] Run Kimi K3's fused collectives through stage boundaries (#42898)
|
2026-10-09 01:27:23 -07:00 |
|
Cheng Wan
|
2b469040d2
|
[Refactor] Support attention-TP dense FFNs and unpadded batches on stage boundaries (#42897)
|
2026-10-09 01:27:00 -07:00 |
|
Cheng Wan
|
b9ae3d1a65
|
[Fix] Run attention on a padded extend batch's real rows (#42896)
|
2026-10-09 01:26:38 -07:00 |
|
Cheng Wan
|
7203747cc8
|
[Fix] Shard Kimi K3's shared experts over the TP group they sum over (#42895)
|
2026-10-09 01:26:15 -07:00 |
|
 MickandMick Qian
|
45ad463c87
|
[diffusion] refactor: deduplicate UniPC solvers and Gemma3 shard loading (#42899)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:26:04 +08:00 |
|
Cheng Wan
|
125f88cb75
|
[Refactor] Run Kimi K3 through stage boundaries (#42894)
|
2026-10-09 01:25:51 -07:00 |
|
Cheng Wan
|
666da4f56b
|
[Fix] Kimi K3 KDA value head size and SiTU input alignment (#42893)
|
2026-10-09 01:25:28 -07:00 |
|
Cheng Wan
|
48a6c0a5d0
|
[Fix] Return an FFN's output to the attention rows at a pipeline handoff (#42892)
|
2026-10-09 01:25:05 -07:00 |
|
Cheng Wan
|
b2402ccad6
|
[Fix] Merge DeepSeek-V4 two-batch-overlap microbatches without a residual (#42891)
|
2026-10-09 01:24:42 -07:00 |
|
 
|
37ae292e6f
|
[diffusion] fix: skip LTX-2 SP masks only for globally unpadded sequences (#43134)
Co-authored-by: yatholam <yatholam@amd.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 15:08:41 +08:00 |
|
 
|
e0608d890e
|
fix: use dp_size instead of attn_dp_size for msprobe rank id (#43041)
Co-authored-by: l30044004 <louyujing@huawei.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
|
2026-10-09 09:40:43 +03:00 |
|
Gabriel Wu
|
217980566a
|
fix(fa4): isolate sheared-bias workspaces by CUDA stream (#33000)
|
2026-10-08 23:37:02 -07:00 |
|
 areneau-cfandJimmy Shong
|
bd2d73daa5
|
[model] support Clef and Clef-Flash decision models on /v1/systemone (#42721)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-09 14:25:52 +08:00 |
|
Michael
|
51f7ea84c7
|
[AMD] Keep MiniMax decode-score tile at 128 tokens off gfx950 (#42772)
|
2026-10-08 23:22:19 -07:00 |
|
 
|
08fc290f48
|
[AMD] gfx950 small-batch MoE: expert-count gate for the small sort and FP8 block-scale small-M kernel (#41982)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-08 23:05:50 -07:00 |
|
 
|
cba1d07a94
|
[Memory] Share one full prefill graph output buffer across shapes for tuple and list outputs (#43176)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-08 23:05:29 -07:00 |
|
 
|
e14ef4b658
|
[Scheduler] Skip the decode for a request whose last token is already in flight (#42720)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-08 23:00:46 -07:00 |
|
 
|
e46aaaa789
|
[diffusion] feat: accept strided row views in the packed QKV all-to-all (#40588)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 13:55:31 +08:00 |
|
Colin Z
|
3c1703d2ff
|
[AMD] Support Quark DeepSeek-V4-MXFP4 checkpoints on the DSV4 stack, enabling shared-expert fusion and MTP (#31054)
|
2026-10-08 22:54:49 -07:00 |
|
 Yuan Luoandluoyuan.luo
|
9a1aeacc3b
|
[GLM-5.3-Flash] Capture the KDA extend in breakable prefill CUDA graphs (#41105)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-10-09 13:37:20 +08:00 |
|
 
|
33e7b4cc4b
|
[diffusion] perf: decode plain base64 MiniMax-H3 materials without a per-character loop (#43117)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 13:25:23 +08:00 |
|
 Chetan Kumar VermaandClaude Fable 5.1
|
5d8e98b7fd
|
[XPU][Diffusion] Plain-torch scale-shift for inductor (#41885)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-09 13:07:14 +08:00 |
|
saatwiknagpal
|
6e7beace14
|
[diffusion] fix: fix int32 offset overflow in the Ulysses packed-QKV pack kernel (#43140)
|
2026-10-09 11:51:46 +08:00 |
|
Baizhou Zhang
|
33bffcd490
|
[CP] GLM-5.3-Flash Prefill CP implemented on layer boundaries (#42044)
|
2026-10-08 20:42:11 -07:00 |
|
 metamergebotandjoshuadeng
|
7859eff6ca
|
[srt] Inject "__req__" into custom_params only for custom logit processors (#43181)
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-08 20:40:50 -07:00 |
|
 
|
4ee3f0f370
|
[Session] Skip the KV free when page alignment empties a streaming-session rewind (#43183)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Joshua Deng <91448271+joshuadeng@users.noreply.github.com>
|
2026-10-08 20:40:25 -07:00 |
|
 
|
4e3eaba619
|
[HiCache] Re-admit a split node's queued buffer-mode write instead of dropping it (#43174)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-08 20:39:41 -07:00 |
|
 HEJIAN SANGandClaude Opus 5.5
|
3e13f1b2c7
|
[Perf] Serialize OpenAI chat/completion responses in one pass (#42889)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 11:17:25 +08:00 |
|
 ormandjandkpham-sgl
|
438df9a2a4
|
[Spec] Fix wrong tokens from compact-verify CUDA graphs when a token tier is captured more than once (#42709)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
|
2026-10-08 19:49:23 -07:00 |
|
Khoa Pham
|
8e19db19b0
|
[KDA] Default safe-gate Blackwell prefill to FlashInfer (#43246)
|
2026-10-08 19:46:28 -07:00 |
|
 Chetan Kumar VermaandClaude Opus 5.5
|
fedab5537b
|
[XPU] Enable ring attention on XPUAttentionBackend (#41406)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-09 10:41:11 +08:00 |
|
 MickandMick Qian
|
df1e4f3f2b
|
[diffusion] refactor: share SANA-WM refiner block computation (#42980)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 10:38:36 +08:00 |
|
Liangsheng Yin
|
f6569bce4d
|
[MemCache] Skip KV events and eviction config on a disabled radix cache (#43253)
|
2026-10-08 19:27:39 -07:00 |
|
Polisetty V R K Jyothendra Varma
|
e54f08c860
|
[XPU] Misc changes to support XPU (#39817)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
|
2026-10-09 10:26:46 +08:00 |
|
Liangsheng Yin
|
e0ab91e3ca
|
[MemCache] Rename SWAChunkCapPoolConfigurator to SWARequestCapPoolConfigurator (#43202)
|
2026-10-08 17:50:51 -07:00 |
|
 
|
b2786a670e
|
[MemCache] Count reclaimable tokens in the unified tree ledgers (#43185)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-08 17:48:11 -07:00 |
|
Liangsheng Yin
|
b4fe282836
|
[MemCache] Delete ChunkCache (#43201)
|
2026-10-08 17:31:16 -07:00 |
|
Liangsheng Yin
|
508ba79688
|
[MemCache] Serve disabled hybrid-SWA models with UnifiedRadixCache (#43200)
|
2026-10-08 17:30:01 -07:00 |
|