 Shu Wang
|
1e8699fda3
|
[NVIDIA][comm] Merge EP+MoE-TP post-experts all-reduces into one _TP reduction (#32963)
|
2026-09-18 01:35:10 -07:00 |
|
|
zhaozx-cn
|
8ac39c66d8
|
[NPU] support kimi k3 on A5 and improve performance (#39589)
|
2026-09-18 16:33:54 +08:00 |
|
|
Rumit DesaiandXiaoyu Zhang
|
1fdd6c8921
|
[Runtime] Let out-of-tree platforms provide full graph backends (#37969)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-18 15:42:46 +08:00 |
|
|
iridiumine
|
f86f60081d
|
[NPU] Adapt hicache for K3 hybrid models (#39415)
|
2026-09-18 14:48:20 +08:00 |
|
|
Jensen
|
3ce3b4969f
|
[NPU] Avoid repeated BF16 wo_a weight transposes in DeepSeek-V4 decode (#39919)
|
2026-09-18 09:10:43 +03:00 |
|
|
maithilijoshi20
|
0dad91d50f
|
Fix int4 MoE tuner config filename (#35260)
Signed-off-by: maithilijoshi20 <maithilij2003@gmail.com>
|
2026-09-18 13:56:38 +08:00 |
|
|
Yuwei An
|
65ef55e2a8
|
[Scheduler] Add shortest-prefill-first scheduling (#40024)
|
2026-09-17 21:18:58 -07:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
c055dc6ff6
|
[CI] Check B200 NUMA mapping against sysfs numa_node (#40055)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-17 21:14:47 -07:00 |
|
|
|
db39b7f961
|
[Fix] Guard conditional top-logprob keys in the completions echo path (#34776)
Co-authored-by: James Liu <jamesl@modal.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-17 19:47:26 -07:00 |
|
|
Nan Jiang
|
740f57a02c
|
[Spec] Fix CDF boundary handling in TreeSpeculativeSamplingTargetOnly (#35798)
|
2026-09-17 19:41:52 -07:00 |
|
|
William Arnoldandishandhanani
|
0214954f26
|
[gRPC] Stream engine state changes (#39915)
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-09-17 19:17:25 -07:00 |
|
|
Liangsheng Yin
|
f65c70bb7d
|
[Kernel] Move CUDA and ROCm speculative kernels to JIT (#40033)
|
2026-09-17 17:27:26 -07:00 |
|
|
Nan Jiang
|
20518d8518
|
[Scheduler] Align RadixCache no-insert cleanup with kv_len_to_handle (#35204)
|
2026-09-17 17:00:59 -07:00 |
|
|
Xiaoyu Zhang
|
7bc9152447
|
[Test] Consolidate kernel tests under plural kernels tree (#39966)
|
2026-09-18 07:37:48 +08:00 |
|
|
Liangsheng Yin
|
1f0c73e9bd
|
[DSV4] Generalize attention metadata, sparse prefill, and KV pool over compress ratios (#39921)
|
2026-09-17 15:55:19 -07:00 |
|
|
Thomas Wang
|
6c73368c32
|
[AMD][DSV4] Enable hicache on deepseek-v4 fp8 unified attn (#37778)
|
2026-09-17 11:29:23 -07:00 |
|
|
|
1f60ddef5d
|
[PD] Introduce runtime role switching between prefill and decode (#28403)
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
|
2026-09-18 01:45:12 +08:00 |
|
|
Byron HsuandByron Hsu
|
a98d921658
|
[DP Attn] Fix crash for no token all-gather case (#39899)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
|
2026-09-17 09:21:09 -07:00 |
|
|
|
25c9f724d4
|
fix(multimodal): handle tensor images in exact-token preprocessing (#30368)
Signed-off-by: Zhuangcheng(Jesse) Gu <zcgu@connect.hku.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-09-17 09:20:21 -07:00 |
|
|
vstone-w
|
a9fb1c3238
|
dsv4(npu): support prefill context parallelism with interleave and zigzag (#39427)
|
2026-09-17 19:59:41 +08:00 |
|
|
Shuwen Wang
|
6ca866ea29
|
[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050)
|
2026-09-17 17:53:58 +08:00 |
|
|
yl3469andShuwen Wang
|
1a90ae6727
|
Add Agentic-Aware Tail-Optimized LRU eviction to the unified radix cache (#34012)
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-09-17 17:52:59 +08:00 |
|
|
|
e970453b43
|
[NPU]Refactor weight processing and add NPUSwigluLimit activation (#38420)
Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2026-09-17 16:40:32 +08:00 |
|
|
|
acfde25d34
|
Carry deferred attention operands and reuse multimodal shared memory (#39870)
Co-authored-by: fei-xx <135589532+fei-xx@users.noreply.github.com>
Co-authored-by: jmswen <jmswen@gmail.com>
|
2026-09-17 01:17:15 -07:00 |
|
|
Lianmin Zhengandjiayisuse
|
882577451e
|
Restrict SafeUnpickler standard-library globals (#39858)
Co-authored-by: jiayisuse <jiayisuse@fb.com>
|
2026-09-17 01:09:55 -07:00 |
|
|
chuyehandjacky.cheng
|
71ef869ece
|
[AMD][Bugfix] Fix vattn_asm HIP error 709 under CUDA graph capture on ROCm 10 (#39513)
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-17 01:06:04 -07:00 |
|
|
Teng MaandTeng Ma
|
15b256bdb0
|
[HiCache] fix: resolve Mooncake local_hostname per node for runtime attach (#29668)
Co-authored-by: Teng Ma <11641725+stmatengss@users.noreply.github.com>
|
2026-09-17 15:51:21 +08:00 |
|
|
Liangsheng YinandBBuf
|
3401b75240
|
dsv4.1: Engram module and request history support (#39666)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-16 23:49:47 -07:00 |
|
|
|
8ae4a39b50
|
Gate mamba extra-buffer predicates on uses_mamba_radix_cache (#37474)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Sam Shleifer <sam@thinkingmachines.ai>
|
2026-09-17 14:39:12 +08:00 |
|
|
Ke BaoandSam Shleifer
|
fd6f96bf96
|
Re-land dp-attention local control broadcast test (#39835)
Co-authored-by: Sam Shleifer <sshleifer@gmail.com>
|
2026-09-17 14:33:25 +08:00 |
|
|
Kurt ShusterandKe Bao
|
6460082c05
|
[Mamba] Fix checkpoint depth for prefixes that end off the radix page (#39115)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-09-17 14:30:57 +08:00 |
|
|
Liangsheng Yin
|
1c4b130bf7
|
[CI] Unify basic and speculative sanity accuracy checks with MMLU (#39906)
|
2026-09-16 22:19:05 -07:00 |
|
|
Liangsheng Yin
|
923e4a56d4
|
[CI] Fix sanity evaluation and diffusion test suite blockers (#39892)
|
2026-09-16 21:47:41 -07:00 |
|
|
|
25ce8063f7
|
Pipeline parallelism x speculative decoding (EAGLE/MTP) compatibility (#30775)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
|
2026-09-16 21:41:54 -07:00 |
|
|
Liangsheng YinandBBuf
|
464fffbec8
|
dsv4.1: chat encoding and tool parsing (#39665)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-16 20:49:42 -07:00 |
|
|
Shuwen Wang
|
33d46376a6
|
[HiCache] Yield idle scheduler so storage workers can drain (#38504)
|
2026-09-17 10:56:11 +08:00 |
|
|
Michele PalazziandTeng Ma
|
329ffc89b9
|
[Mooncake] Fix silent SSD offload corruption when TP/PP ranks share ssd_offload_path (#31926)
Signed-off-by: Michele Palazzi <sysdadmin@m1k.cloud>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2026-09-17 10:51:03 +08:00 |
|
|
|
84d7604b7e
|
[XPU] weekly simple model enablement 2026/09/14 (#39439)
Co-authored-by: Juan Muneton <102537701+jmunetong@users.noreply.github.com>
Co-authored-by: YangKai0616 <kai.yang@intel.com>
Co-authored-by: devan-carlin <devan-carlin@users.noreply.github.com>
Co-authored-by: Ashwini Rathi <arathi@habana.ai>
Co-authored-by: Ranjan Debnath <ranjan.debnath@intel.com>
Co-authored-by: Juan Muneton <juan.muneton.gallego@intel.com>
Co-authored-by: Amrutha M <amrutha.m@intel.com>
|
2026-09-17 10:43:04 +08:00 |
|
|
|
4793f56835
|
[HiCache] Keep hybrid transfer layer maps stage-local under PP (#39699)
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-09-17 10:18:44 +08:00 |
|
|
qyb233
|
4fb9b5b5ba
|
feat(hicache): support NPU Mamba states with FIA and async IO (#32500)
|
2026-09-17 10:12:26 +08:00 |
|
|
Shuwen Wang
|
4c85172f3a
|
[HiCache] Back up MXFP8 KV scales in the host pool (#39089)
|
2026-09-17 09:40:26 +08:00 |
|
|
|
c89c63fa38
|
dsv4.1: vision tower and image preprocessing (#39668)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-09-16 18:11:16 -07:00 |
|
|
Liangsheng Yin
|
dc067c7d8c
|
[Fix] Allow closed object schemas in Outlines prevalidation (#39869)
|
2026-09-16 16:42:17 -07:00 |
|
|
William Arnoldandishandhanani
|
f45aad44bd
|
[gRPC] Expose native pause status (#37488)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-09-16 15:16:52 -07:00 |
|
|
|
13d593b6cf
|
dsv4.1: compression, KV I/O, and metadata kernels (#39652)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
|
2026-09-16 13:54:07 -07:00 |
|
|
Justin Perlman
|
869674b3a7
|
[Fix] Prevalidate JSON Schema support per grammar backend (#37839)
|
2026-09-16 13:10:15 -07:00 |
|
|
Qiaolin Yu
|
43390f63f5
|
[qwen 3.8 next] change the testing model in test_qwen4_exp_models.py (#39662)
|
2026-09-16 12:47:45 -07:00 |
|
|
Xinyuan Tong
|
f0bf652534
|
Add Ling-3.0-flash-VL model support (#38526)
|
2026-09-17 00:19:26 +08:00 |
|
|
cctry
|
1b78083b42
|
[PD] Add optional KV transfer checksums (#39500)
|
2026-09-16 23:53:30 +08:00 |
|
|
AMD-yanfeiwangandDuyi-Wang
|
a813224e78
|
[ROCm][DSV4] Enable breakable CUDA graph prefill (#37810)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-09-16 08:52:11 -07:00 |
|