 
|
cec70a4708
|
[Fix] Keep the target's DP sync slot in draft scopes (#41062)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-09-24 21:48:39 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
3fc7a669bf
|
[CI] Move GLM-5.2 layer-split test to extra-b-test-8-gpu-b300 (#41207)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-24 21:25:48 -07:00 |
|
 
|
e0b4d66733
|
[Perf] Lazy-load built-in model definitions and nixl_ep at startup (#41061)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-09-24 20:29:33 -07:00 |
|
 
|
7325b38412
|
[PD] Honor gracefully_exit in disaggregation event loops and keep non-zero-rank launchers alive on SIGTERM (#40793)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Shiyan Deng <dsy842974287@meta.com>
|
2026-09-24 20:29:07 -07:00 |
|
akhilg-nv
|
37ebcac3c4
|
Support XQA backend for SpecDec verify (#32269)
|
2026-09-24 20:14:46 -07:00 |
|
jacky.cheng
|
9dc4c5d891
|
[AMD] Restore non-DCP Mamba checkpoint donation to fix agent-mode cache hit at high conc with HiCache (#40907)
|
2026-09-24 18:08:10 -07:00 |
|
Liangsheng Yin
|
8ca82118e0
|
[mem_cache] Drop is_insert from cache_finished_req; release rows from release_kv_cache (#40988)
|
2026-09-24 17:23:26 -07:00 |
|
 Shuwen Wangandhnyls2002
|
a2025b8c4d
|
[DSV4] Account for FlashMLA physical KV page padding in memory budgets (#41091)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-24 17:14:08 -07:00 |
|
Sundara Raman Ramachandran
|
2f2f9d12f8
|
[Score API] Setwise Scoring Support (#38965)
|
2026-09-24 16:50:58 -07:00 |
|
 
|
466e985f4b
|
[HiCache] Batch buffer-only KV backups within each flush (#40960)
Co-authored-by: oss-sync bot (pranjalssh) <pranjalssh@users.noreply.github.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
|
2026-09-24 16:13:02 -07:00 |
|
 Caio RochaandCaio Rocha
|
e047e50d4e
|
Add 8-node AllReduce/AllGather and MNVLS algorithm support to MSCCL++ (#37442)
Co-authored-by: Caio Rocha <caiorocha@microsft.com>
|
2026-09-24 15:51:29 -07:00 |
|
Yuwei An
|
3ec86307f2
|
Fix mixed chunk prefill with DP speculative coordination (#41179)
|
2026-09-24 15:41:49 -07:00 |
|
Liangsheng Yin
|
0c578d97fe
|
[DSV4] Size compressed pools from one per-ratio table in DSV4PoolConfigurator (#41049)
|
2026-09-24 15:19:02 -07:00 |
|
Liangsheng Yin
|
182f62d2de
|
[Fix] Patch set_dp_buffer_len_from_batch in DP spec prefill coordination test (#41162)
|
2026-09-24 13:52:11 -07:00 |
|
Shuwen Wang
|
961404b010
|
[DSV4] Fix TRTLLM uniform FP8 KV memory budgeting (#41090)
|
2026-09-24 13:25:00 -07:00 |
|
    
|
0b53305f48
|
MiniMax-M3: MXFP8 dense-only block convert + aiter MXFP8 MoE on gfx950 (#36574)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: mikevin920 <mikevin920@yahoo.com>
Co-authored-by: Kevin Mi <mikevin920@gmail.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
|
2026-09-24 13:16:59 -07:00 |
|
Cheng Wan
|
5bb850d536
|
[Refactor] Split prepare_attn into a reduction step and per-quant-format residual steps (#41084)
|
2026-09-24 12:16:54 -07:00 |
|
Cheng Wan
|
a80055d3c6
|
[Fix] Broadcast requests along attention CP before attention TP (#41083)
|
2026-09-24 12:16:27 -07:00 |
|
Cheng Wan
|
7c9f74c6e1
|
[Fix] Step-3.5: stop dense layers from summing their output twice under DP attention (#41082)
|
2026-09-24 12:15:58 -07:00 |
|
Cheng Wan
|
62ae032c46
|
[Refactor] Share the MoE output all-reduce between models (#41097)
|
2026-09-24 12:15:33 -07:00 |
|
Cheng Wan
|
5df1667077
|
[Refactor] Pass each layer stack's output through a communicator exit (#41081)
|
2026-09-24 12:15:07 -07:00 |
|
 Cheng WanandMick Qian
|
07a3735e94
|
[Fix] Complete the deferred FFN all-reduce before deepstack addition and aux hidden-state capture (#41080)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-24 12:14:39 -07:00 |
|
Cheng Wan
|
928e683f94
|
[Fix] Complete the deferred FFN all-reduce before a pipeline-parallel send (#41079)
|
2026-09-24 12:13:57 -07:00 |
|
Khoa Pham
|
1b03d31b31
|
[Test] Run the Qwen3.5 Triton DCP nightly with the radix cache enabled (#41155)
|
2026-09-24 12:00:09 -07:00 |
|
 
|
f404db94d4
|
[DP attention] Publish DP buffer sizes from a ForwardBatch (#40858)
Co-authored-by: hanminglu <hanminglu@fb.com>
Co-authored-by: oss-sync bot (pranjalssh) <pranjalssh@users.noreply.github.com>
|
2026-09-24 11:34:19 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
86b3558b41
|
[Fix] Skip the DCP target-verify MLA kernel during FlashInfer autotune (#41138)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-24 11:19:28 -07:00 |
|
   
|
78b382b1ad
|
Support unified memory decode host pools (#39478)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yonghao Zhuang <yhzhuang@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-09-24 11:02:15 -07:00 |
|
 Jackey HuaandClaude Fable 5.1
|
5bb24e399d
|
[Quant] ModelOpt mixed precision: dispatch block-FP8 MoE experts and derive the block size (#38726)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-24 12:30:01 -04:00 |
|
 Shangming CaiandClaude Fable 5
|
77173ffb08
|
[HiCache] Demote SWA KV to host on write_back eviction instead of dropping it (#40712)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-24 23:56:17 +08:00 |
|
Ting SUN
|
752801e4d1
|
fix(sampling): validate sampling_seed is an int within int64 range (#28960)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-09-24 17:25:13 +02:00 |
|
 Shangming CaiandClaude Opus 5
|
cd11037009
|
[PD] Enable deferred decode-side KV release by default (#41023)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-24 22:35:11 +08:00 |
|
黄孝君
|
4142235c2b
|
[NPU] Update CANN version to 9.1.0 (#40524)
|
2026-09-24 21:35:31 +08:00 |
|
Xiaoyu Zhang
|
ea5baf4022
|
[Refactor] Retire the model-specific Kimi K3 kernel namespace (#40922)
|
2026-09-24 21:25:00 +08:00 |
|
paulzhang-tm
|
28ec6700da
|
[HiCache] Make host reclamation independent of transfer order (#40512)
|
2026-09-24 21:03:25 +08:00 |
|
 
|
3177d10ca6
|
Refactor the Cute-DSL AR fusion to support DeepseekV2 archs (GLM-5.3, etc.) (#39816)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-09-24 06:00:58 -07:00 |
|
Xiaoyu Zhang
|
26c63335e2
|
[Diffusion] Fuse lossless LingBot World FP32 normalization (#40425)
|
2026-09-24 18:41:10 +08:00 |
|
Zhang, Jiejing
|
d94d784441
|
[AMD] Tune Triton sparse MLA on gfx950 and make split-K workspaces graph-safe (#39059)
|
2026-09-24 03:21:53 -07:00 |
|
Xiaoyu Zhang
|
c85df5becc
|
[Diffusion] Fuse lossless Wan VAE post-ops for LongLive 2 I2V (#40405)
|
2026-09-24 17:40:07 +08:00 |
|
Xiaoyu Zhang
|
261cb826e6
|
[Diffusion] Fuse LongCat GELU+cat and support Edit-Turbo BCG (#40384)
|
2026-09-24 17:27:56 +08:00 |
|
 MickandMick Qian
|
174a5f37b9
|
[feature] add per-item candidate token scoring and calibration (#40826)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-24 17:00:13 +08:00 |
|
pllimax
|
d65503fece
|
[NPU] Remove the LLaDA2.0-mini basic-function test case (#40905)
|
2026-09-24 15:58:48 +08:00 |
|
Yuwei An
|
1417345f5f
|
[Experimental] Preserve speculative decoding during prefill across DP ranks (#40118)
|
2026-09-24 00:01:12 -07:00 |
|
Liangsheng Yin
|
cae4927fbf
|
[DSV4] Budget the ratio-2 pair state pool in DSV4PoolConfigurator (#41048)
|
2026-09-23 23:53:46 -07:00 |
|
Michael
|
a164c6d9f1
|
[AMD] Register mem-cache unit tests in PR CI (#40812)
|
2026-09-23 23:35:51 -07:00 |
|
 
|
32290dda2c
|
[AMD] Small-M MXFP4 fused-MoE kernel for gfx950 (Qwen) (#40204)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-23 22:45:33 -07:00 |
|
Shuwen Wang
|
90663ccb41
|
[DSV4] fix: size the C4 state ring by the page it is addressed by (#40337)
|
2026-09-23 22:05:32 -07:00 |
|
 cctryandcctry
|
efff836911
|
[PD] Add decode host receive for custom transfer backends (#40238)
Co-authored-by: cctry <cctry@fb.com>
|
2026-09-23 21:57:33 -07:00 |
|
 fanxingranandThomas Wang
|
0dc8b29e15
|
[ROCm][DSA] Enable AITER fused FP8 indexer writer (#40710)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-09-23 21:46:35 -07:00 |
|
Nan Jiang
|
c3685dff42
|
[Sampling] Add selected/support sampling logprob modes (#40932)
|
2026-09-23 21:38:19 -07:00 |
|
Jimmy Shong
|
be495a6174
|
[Fix] Use cached prefix lengths for FlashInfer full-attention ragged prefill (#40796)
|
2026-09-23 17:23:25 -10:00 |
|