|
1f60ddef5d
|
[PD] Introduce runtime role switching between prefill and decode (#28403)
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
|
2026-09-18 01:45:12 +08:00 |
|
|
Byron HsuandByron Hsu
|
a98d921658
|
[DP Attn] Fix crash for no token all-gather case (#39899)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
|
2026-09-17 09:21:09 -07:00 |
|
|
|
25c9f724d4
|
fix(multimodal): handle tensor images in exact-token preprocessing (#30368)
Signed-off-by: Zhuangcheng(Jesse) Gu <zcgu@connect.hku.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-09-17 09:20:21 -07:00 |
|
|
pllimax
|
7ccbf5fd04
|
[NPU][CI] Increase e2e multi-node test timeout to 210 minutes (#39952)
|
2026-09-17 20:50:33 +08:00 |
|
|
vstone-w
|
a9fb1c3238
|
dsv4(npu): support prefill context parallelism with interleave and zigzag (#39427)
|
2026-09-17 19:59:41 +08:00 |
|
|
jacky.cheng
|
11c35b8433
|
[AMD] Load fused shared experts for Qwen4-Exp and Qwen3.5 MTP (#38878)
|
2026-09-17 19:56:31 +08:00 |
|
|
Arseniy Mironov
|
a1b4ec02ae
|
[NPU][Diffusion] FA MXFP8 and modelslim w4a4f8 and w8a8f8 support for Wan2.2 and FLUX (#39438)
|
2026-09-17 13:13:05 +03:00 |
|
|
Shuwen Wang
|
6ca866ea29
|
[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050)
|
2026-09-17 17:53:58 +08:00 |
|
|
yl3469andShuwen Wang
|
1a90ae6727
|
Add Agentic-Aware Tail-Optimized LRU eviction to the unified radix cache (#34012)
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-09-17 17:52:59 +08:00 |
|
|
silencejade
|
575759d90a
|
[NPU] Support nccl backend for --remote-instance-weight-loader (#39413)
|
2026-09-17 17:28:15 +08:00 |
|
|
|
e970453b43
|
[NPU]Refactor weight processing and add NPUSwigluLimit activation (#38420)
Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2026-09-17 16:40:32 +08:00 |
|
|
chuyehandchuyeh
|
2d08cc5ede
|
[AMD][Spec] Enable GDN ReplaySSM target-verify on ROCm (#38184)
Co-authored-by: chuyeh <298092489+chuyeh@users.noreply.github.com>
|
2026-09-17 01:29:14 -07:00 |
|
|
|
acfde25d34
|
Carry deferred attention operands and reuse multimodal shared memory (#39870)
Co-authored-by: fei-xx <135589532+fei-xx@users.noreply.github.com>
Co-authored-by: jmswen <jmswen@gmail.com>
|
2026-09-17 01:17:15 -07:00 |
|
|
Lianmin Zhengandjiayisuse
|
882577451e
|
Restrict SafeUnpickler standard-library globals (#39858)
Co-authored-by: jiayisuse <jiayisuse@fb.com>
|
2026-09-17 01:09:55 -07:00 |
|
|
chuyehandjacky.cheng
|
71ef869ece
|
[AMD][Bugfix] Fix vattn_asm HIP error 709 under CUDA graph capture on ROCm 10 (#39513)
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-17 01:06:04 -07:00 |
|
|
Teng MaandTeng Ma
|
15b256bdb0
|
[HiCache] fix: resolve Mooncake local_hostname per node for runtime attach (#29668)
Co-authored-by: Teng Ma <11641725+stmatengss@users.noreply.github.com>
|
2026-09-17 15:51:21 +08:00 |
|
|
Shijin Zhang
|
aebae58b8c
|
[Moe] Fix flashinfer_trtllm silently dropping swiglu_limit clamped SwiGLU activation (#39920)
|
2026-09-17 00:25:17 -07:00 |
|
|
MickandMick Qian
|
f3c0256771
|
[diffusion] chore: remove retired auto-residency workload helpers (#39884)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-17 15:16:35 +08:00 |
|
|
faceless voidandronnie_zheng
|
44bd359082
|
[NPU][Diffusion] Optimize SenseNova-U1 batched generation (#39382)
Signed-off-by: syd520zy <529477025@qq.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-09-17 10:08:20 +03:00 |
|
|
Liangsheng YinandBBuf
|
3401b75240
|
dsv4.1: Engram module and request history support (#39666)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-16 23:49:47 -07:00 |
|
|
|
8ae4a39b50
|
Gate mamba extra-buffer predicates on uses_mamba_radix_cache (#37474)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Sam Shleifer <sam@thinkingmachines.ai>
|
2026-09-17 14:39:12 +08:00 |
|
|
Ke BaoandSam Shleifer
|
fd6f96bf96
|
Re-land dp-attention local control broadcast test (#39835)
Co-authored-by: Sam Shleifer <sshleifer@gmail.com>
|
2026-09-17 14:33:25 +08:00 |
|
|
Kurt ShusterandKe Bao
|
6460082c05
|
[Mamba] Fix checkpoint depth for prefixes that end off the radix page (#39115)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-09-17 14:30:57 +08:00 |
|
|
karverma-amd
|
fa8d22e665
|
[AMD][DSV4] Allow moe_a2a_backend='mori' with DSpark + dp attention (#39910)
|
2026-09-16 23:09:41 -07:00 |
|
|
ZiruandNiu Ziru
|
9d0a8d7536
|
[CPU] Upgrade torch cpu dependencies to version 2.14. (#37939)
Co-authored-by: Niu Ziru <niuziru@a4bf018d3341.jf.intel.com>
|
2026-09-17 14:01:43 +08:00 |
|
|
BingjiaWang
|
7782a2a1c8
|
[Benchmark] Limit warmup concurrency in serving benchmark (#39398)
|
2026-09-16 22:58:10 -07:00 |
|
|
MickandMick Qian
|
c525ed8f02
|
[diffusion] fix: preserve explicit attention backends during autotune (#39882)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-17 13:28:55 +08:00 |
|
|
Liangsheng Yin
|
1c4b130bf7
|
[CI] Unify basic and speculative sanity accuracy checks with MMLU (#39906)
|
2026-09-16 22:19:05 -07:00 |
|
|
Liangsheng Yin
|
923e4a56d4
|
[CI] Fix sanity evaluation and diffusion test suite blockers (#39892)
|
2026-09-16 21:47:41 -07:00 |
|
|
|
25ce8063f7
|
Pipeline parallelism x speculative decoding (EAGLE/MTP) compatibility (#30775)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
|
2026-09-16 21:41:54 -07:00 |
|
|
Chetan Kumar VermaandClaude Opus 5
|
2733afe54e
|
[diffusion] Fix the XPU capability gates that broke the Wan2.2 A14B DiT path (#36825)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-17 12:15:07 +08:00 |
|
|
Liangsheng YinandBBuf
|
464fffbec8
|
dsv4.1: chat encoding and tool parsing (#39665)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-16 20:49:42 -07:00 |
|
|
Shuwen Wang
|
33d46376a6
|
[HiCache] Yield idle scheduler so storage workers can drain (#38504)
|
2026-09-17 10:56:11 +08:00 |
|
|
Chunan ZengandKevin Mi
|
241a5b9823
|
MiniMax-M3: allow shared-experts fusion on ROCm gfx942 and newer (#36576)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
|
2026-09-16 19:55:47 -07:00 |
|
|
Michele PalazziandTeng Ma
|
329ffc89b9
|
[Mooncake] Fix silent SSD offload corruption when TP/PP ranks share ssd_offload_path (#31926)
Signed-off-by: Michele Palazzi <sysdadmin@m1k.cloud>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2026-09-17 10:51:03 +08:00 |
|
|
|
84d7604b7e
|
[XPU] weekly simple model enablement 2026/09/14 (#39439)
Co-authored-by: Juan Muneton <102537701+jmunetong@users.noreply.github.com>
Co-authored-by: YangKai0616 <kai.yang@intel.com>
Co-authored-by: devan-carlin <devan-carlin@users.noreply.github.com>
Co-authored-by: Ashwini Rathi <arathi@habana.ai>
Co-authored-by: Ranjan Debnath <ranjan.debnath@intel.com>
Co-authored-by: Juan Muneton <juan.muneton.gallego@intel.com>
Co-authored-by: Amrutha M <amrutha.m@intel.com>
|
2026-09-17 10:43:04 +08:00 |
|
|
|
4793f56835
|
[HiCache] Keep hybrid transfer layer maps stage-local under PP (#39699)
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-09-17 10:18:44 +08:00 |
|
|
|
0daa040e48
|
Support LongBench v2 in one-batch server benchmarks (#39874)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: YJYJLee <yejinlee@meta.com>
|
2026-09-16 19:16:03 -07:00 |
|
|
qyb233
|
4fb9b5b5ba
|
feat(hicache): support NPU Mamba states with FIA and async IO (#32500)
|
2026-09-17 10:12:26 +08:00 |
|
|
Shuwen Wang
|
4c85172f3a
|
[HiCache] Back up MXFP8 KV scales in the host pool (#39089)
|
2026-09-17 09:40:26 +08:00 |
|
|
William Hu
|
0443e3179f
|
fix(kda_prefill): fence shared writes before async proxy reads (#39124)
|
2026-09-16 18:37:19 -07:00 |
|
|
Xinyi Song
|
7780882f18
|
[AMD][bugfix] Fix dsv4 server launch (#39875)
|
2026-09-16 18:28:02 -07:00 |
|
|
|
c89c63fa38
|
dsv4.1: vision tower and image preprocessing (#39668)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-09-16 18:11:16 -07:00 |
|
|
Liangsheng Yin
|
408d2334c3
|
dsv4.1: mHC computation and compensated projections (#39664)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-09-16 17:11:55 -07:00 |
|
|
|
46ae84df15
|
dsv4.1: Hopper FP8 matmul kernels and tuning (#39657)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-09-16 16:54:19 -07:00 |
|
|
Liangsheng Yin
|
dc067c7d8c
|
[Fix] Allow closed object schemas in Outlines prevalidation (#39869)
|
2026-09-16 16:42:17 -07:00 |
|
|
|
c2443458e1
|
dsv4.1: RoPE and FP4 packing kernels (#39656)
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-16 16:17:12 -07:00 |
|
|
William Arnoldandishandhanani
|
f45aad44bd
|
[gRPC] Expose native pause status (#37488)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-09-16 15:16:52 -07:00 |
|
|
|
35b7589e1a
|
dsv4.1: candidate indexer library (#39671)
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-16 15:15:18 -07:00 |
|
|
|
13d593b6cf
|
dsv4.1: compression, KV I/O, and metadata kernels (#39652)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
|
2026-09-16 13:54:07 -07:00 |
|