 Ziang Li
|
c46bf5e990
|
[MoE] Disable FlashInfer fused finalize by default for numerical accuracy (#40105)
|
2026-09-18 00:15:57 -07:00 |
|
|
Ke Bao
|
956d414dad
|
Update ci permission (#40121)
|
2026-09-18 15:12:36 +08:00 |
|
|
Shuwen Wang
|
0be8a0af0e
|
[DSV4] fix: keep the TileLang JIT cache under SGLANG_CACHE_DIR (#39364)
|
2026-09-18 00:06:35 -07:00 |
|
|
|
3bf243d6a9
|
[Router] Shard the cache-aware KV tree by chain root (#39167)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-18 15:00:17 +08:00 |
|
|
iridiumine
|
f86f60081d
|
[NPU] Adapt hicache for K3 hybrid models (#39415)
|
2026-09-18 14:48:20 +08:00 |
|
|
amote-i
|
6952538980
|
[NPU] [DOC] delete unsupported api --disable-hybrid-swa-memory for npu (#40058)
|
2026-09-18 14:31:05 +08:00 |
|
|
Xinyuan Tong
|
4dbba37965
|
Verify the Ling-3.0-flash-VL FP4 lane on H200 and disable shared-expert fusion in quant recipes (#39419)
|
2026-09-17 23:20:18 -07:00 |
|
|
Jensen
|
3ce3b4969f
|
[NPU] Avoid repeated BF16 wo_a weight transposes in DeepSeek-V4 decode (#39919)
|
2026-09-18 09:10:43 +03:00 |
|
|
黄孝君
|
d337b865af
|
Update NPU tag to post4 version and related scripts (#39953)
|
2026-09-18 14:03:07 +08:00 |
|
|
Bojiang LiandXiaoyu Zhang
|
3d1b9e7549
|
[Bugfix] Include SM121 in DeepGEMM packed-scale selection (#39482)
Signed-off-by: bojiang-li <327132355+bojiang-li@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-18 13:57:14 +08:00 |
|
|
maithilijoshi20
|
0dad91d50f
|
Fix int4 MoE tuner config filename (#35260)
Signed-off-by: maithilijoshi20 <maithilij2003@gmail.com>
|
2026-09-18 13:56:38 +08:00 |
|
|
Hanming Luandhanminglu
|
6e1d9c1464
|
[profiler] Ignore PREBUILT batches in profile-by-stage (#40098)
Co-authored-by: hanminglu <hanminglu@fb.com>
|
2026-09-17 22:33:55 -07:00 |
|
|
Chi McIsaacandMick Qian
|
6215aecd51
|
[diffusion] feat: add metrics support (#19084)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-18 13:22:03 +08:00 |
|
|
Yuwei An
|
65ef55e2a8
|
[Scheduler] Add shortest-prefill-first scheduling (#40024)
|
2026-09-17 21:18:58 -07:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
c055dc6ff6
|
[CI] Check B200 NUMA mapping against sysfs numa_node (#40055)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-17 21:14:47 -07:00 |
|
|
|
826d5170ae
|
[Bug] Guard FlashInfer CUTLASS MoE against 0-token inputs (#38780)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-18 11:03:27 +08:00 |
|
|
Zixin HuangandClaude Fable 5.1
|
f447bb7080
|
[Kernel] Coalesce the KDA CuTe DSL decode state transpose: ~3x faster, bit-identical (#39680)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-18 10:53:13 +08:00 |
|
|
|
db39b7f961
|
[Fix] Guard conditional top-logprob keys in the completions echo path (#34776)
Co-authored-by: James Liu <jamesl@modal.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-17 19:47:26 -07:00 |
|
|
Nan Jiang
|
740f57a02c
|
[Spec] Fix CDF boundary handling in TreeSpeculativeSamplingTargetOnly (#35798)
|
2026-09-17 19:41:52 -07:00 |
|
|
William Arnoldandishandhanani
|
0214954f26
|
[gRPC] Stream engine state changes (#39915)
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-09-17 19:17:25 -07:00 |
|
|
YanbingJiangandMa Mingfei
|
a407915c17
|
[CPU] Avoid prefill CP predicates during decode graph capture (#39690)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-18 09:21:05 +08:00 |
|
|
Liangsheng Yin
|
f65c70bb7d
|
[Kernel] Move CUDA and ROCm speculative kernels to JIT (#40033)
|
2026-09-17 17:27:26 -07:00 |
|
|
Nan Jiang
|
20518d8518
|
[Scheduler] Align RadixCache no-insert cleanup with kv_len_to_handle (#35204)
|
2026-09-17 17:00:59 -07:00 |
|
|
Xiaoyu Zhang
|
7bc9152447
|
[Test] Consolidate kernel tests under plural kernels tree (#39966)
|
2026-09-18 07:37:48 +08:00 |
|
|
Khoa Pham
|
b98a2d1096
|
[Docs] GLM-5.3-Flash cookbook: temporarily remove the DCP option (#40036)
|
2026-09-17 16:17:25 -07:00 |
|
|
Liangsheng Yin
|
1f0c73e9bd
|
[DSV4] Generalize attention metadata, sparse prefill, and KV pool over compress ratios (#39921)
|
2026-09-17 15:55:19 -07:00 |
|
|
Ren YuzhouandRen Yuzhou
|
4f52a27563
|
[AMD] Fix DSV4 FP4 dequant path for AITER on ROCm (#35123)
Co-authored-by: Ren Yuzhou <yuzhouo7@users.noreply.github.com>
|
2026-09-17 13:51:22 -07:00 |
|
|
Lianmin Zheng
|
126c2f1bc1
|
[CI] Add metamergebot to CI permissions (#40017)
|
2026-09-17 13:39:00 -07:00 |
|
|
|
72d9419bef
|
[Router] Sample k random candidates for the min-load fallback (--min-load-choices) (#39170)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-18 03:09:09 +08:00 |
|
|
Thomas Wang
|
6c73368c32
|
[AMD][DSV4] Enable hicache on deepseek-v4 fp8 unified attn (#37778)
|
2026-09-17 11:29:23 -07:00 |
|
|
|
1f60ddef5d
|
[PD] Introduce runtime role switching between prefill and decode (#28403)
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
|
2026-09-18 01:45:12 +08:00 |
|
|
Byron HsuandByron Hsu
|
a98d921658
|
[DP Attn] Fix crash for no token all-gather case (#39899)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
|
2026-09-17 09:21:09 -07:00 |
|
|
|
25c9f724d4
|
fix(multimodal): handle tensor images in exact-token preprocessing (#30368)
Signed-off-by: Zhuangcheng(Jesse) Gu <zcgu@connect.hku.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-09-17 09:20:21 -07:00 |
|
|
|
e4cbb28ea1
|
[router] Improve SGLang chat render parity (#39133)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-17 23:53:40 +08:00 |
|
|
pllimax
|
7ccbf5fd04
|
[NPU][CI] Increase e2e multi-node test timeout to 210 minutes (#39952)
|
2026-09-17 20:50:33 +08:00 |
|
|
vstone-w
|
a9fb1c3238
|
dsv4(npu): support prefill context parallelism with interleave and zigzag (#39427)
|
2026-09-17 19:59:41 +08:00 |
|
|
jacky.cheng
|
11c35b8433
|
[AMD] Load fused shared experts for Qwen4-Exp and Qwen3.5 MTP (#38878)
|
2026-09-17 19:56:31 +08:00 |
|
|
Arseniy Mironov
|
a1b4ec02ae
|
[NPU][Diffusion] FA MXFP8 and modelslim w4a4f8 and w8a8f8 support for Wan2.2 and FLUX (#39438)
|
2026-09-17 13:13:05 +03:00 |
|
|
Shuwen Wang
|
6ca866ea29
|
[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050)
|
2026-09-17 17:53:58 +08:00 |
|
|
yl3469andShuwen Wang
|
1a90ae6727
|
Add Agentic-Aware Tail-Optimized LRU eviction to the unified radix cache (#34012)
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-09-17 17:52:59 +08:00 |
|
|
silencejade
|
575759d90a
|
[NPU] Support nccl backend for --remote-instance-weight-loader (#39413)
|
2026-09-17 17:28:15 +08:00 |
|
|
|
e970453b43
|
[NPU]Refactor weight processing and add NPUSwigluLimit activation (#38420)
Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2026-09-17 16:40:32 +08:00 |
|
|
chuyehandchuyeh
|
2d08cc5ede
|
[AMD][Spec] Enable GDN ReplaySSM target-verify on ROCm (#38184)
Co-authored-by: chuyeh <298092489+chuyeh@users.noreply.github.com>
|
2026-09-17 01:29:14 -07:00 |
|
|
|
acfde25d34
|
Carry deferred attention operands and reuse multimodal shared memory (#39870)
Co-authored-by: fei-xx <135589532+fei-xx@users.noreply.github.com>
Co-authored-by: jmswen <jmswen@gmail.com>
|
2026-09-17 01:17:15 -07:00 |
|
|
Lianmin Zhengandjiayisuse
|
882577451e
|
Restrict SafeUnpickler standard-library globals (#39858)
Co-authored-by: jiayisuse <jiayisuse@fb.com>
|
2026-09-17 01:09:55 -07:00 |
|
|
chuyehandjacky.cheng
|
71ef869ece
|
[AMD][Bugfix] Fix vattn_asm HIP error 709 under CUDA graph capture on ROCm 10 (#39513)
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-17 01:06:04 -07:00 |
|
|
Kan WuandClaude Fable 5.1
|
3ce7e2a29f
|
[sgl-router] Render chat prompts with dynamo-render (#38983)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-17 15:57:20 +08:00 |
|
|
Teng MaandTeng Ma
|
15b256bdb0
|
[HiCache] fix: resolve Mooncake local_hostname per node for runtime attach (#29668)
Co-authored-by: Teng Ma <11641725+stmatengss@users.noreply.github.com>
|
2026-09-17 15:51:21 +08:00 |
|
|
Shijin Zhang
|
aebae58b8c
|
[Moe] Fix flashinfer_trtllm silently dropping swiglu_limit clamped SwiGLU activation (#39920)
|
2026-09-17 00:25:17 -07:00 |
|
|
MickandMick Qian
|
f3c0256771
|
[diffusion] chore: remove retired auto-residency workload helpers (#39884)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-17 15:16:35 +08:00 |
|