Commit Graph
6055 Commits
Author SHA1 Message Date
faceless voidandgithub-actions[bot] 30d0eb2ca9 [NPU] Adapt DFlash2 speculative decoding to Ascend NPUs (#35629)
Signed-off-by: syd520zy <529477025@qq.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-09-07 09:08:39 +08:00
sglang-botandsglang-bot 6252993afe chore: update CI test est_time values (#38238)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-09-06 17:49:41 -07:00
JohnQinAMD 2c05ed4e77 [ROCm] Stage large pageable H2D copies instead of pinning them in place (#37720) 2026-09-06 12:28:58 -07:00
31d28a2961 [NPU] Fix failed test cases in pr‑test‑npu and improve execution efficiency (#38112)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-09-07 01:48:27 +08:00
s 28457f0dca fix(gpt-oss): avoid duplicate MoE reduction with DP attention (#37199) 2026-09-07 00:33:04 +08:00
+2 97c6978369 GLM-5.3-Flash support (#36507)
Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2@liverpool.ac.uk>
Co-authored-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: zanes-ops <zanes@nvidia.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Jian Chen <jianchen0311@gmail.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: andyluo7 <43718156+andyluo7@users.noreply.github.com>
Co-authored-by: Ehsan Akhgari <ehsan.akhgari@gmail.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Raiden Makoto <81530826+Raiden-Makoto@users.noreply.github.com>
2026-09-06 02:27:59 -07:00
Mickandmickqian 8ef646a5c6 fix(vlm): contain EPD request lifecycle failures (#36944)
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
2026-09-06 16:05:10 +08:00
Vincent Gao ae54ccb25d [Router] Publish cache-aware load state (#38139) 2026-09-06 15:22:25 +08:00
Mick febb360519 [VLM] retire aborted disaggregated prefill results (#36988) 2026-09-06 10:15:33 +08:00
Liangsheng Yin f5819b09bf Revert "[AMD][DSV4] Fix unified-KV pool sizing and SWA ring accounting" (#38163) 2026-09-05 17:28:46 -07:00
Mohammad Miadh AngkadandMohammad Angkad 09daea94ac Support NoPE layers in the tokenspeed_mla FP8 prefill hook (#38152)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-09-05 16:51:04 -07:00
yuttian1 514b45fd34 [AMD][DSV4] Fix unified-KV pool sizing and SWA ring accounting (#30315) 2026-09-05 16:39:40 -07:00
Alex NailsandClaude Opus 5 6a0c55fd6c [CI] Pin the Rust TreeCore build to the resolved libtorch instead of interpreter discovery (#37696)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-05 15:30:32 -07:00
Xiaoyu ZhangandWaterpine ccf9fe6590 [Kernel] Add KDA FP8 skinny GEMM for SM120 (#38082)
Co-authored-by: Waterpine <biansonghz@gmail.com>
2026-09-05 22:27:06 +08:00
Xiaoyu Zhang dc2843801d perf(lfm2): fuse gating and short convolution on SM90 (#37622) 2026-09-05 21:52:16 +08:00
Beihao Zhou 1e6f18bfeb [MoE Refactor] Migrate SM100 trtllm-gen mxfp4 MoE onto MoeRunner (#32405) 2026-09-05 13:48:10 +00:00
Mick 5df60a21cd fix(vlm): harden EPD receiver validation and liveness (#36945) 2026-09-05 21:22:37 +08:00
4b802c052b test(npu): remove obsolete npu pr nightly cases, move accuracy cases to full (#37990)
Co-authored-by: Sugar920 <Sugar920@users.noreply.github.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
2026-09-05 20:58:52 +08:00
Mick a18106bbc3 fix(vlm): make EPD cache publication transactional (#36949) 2026-09-05 20:33:23 +08:00
bd16c22a04 [diffusion] fuse LingBot MoE group-limited top-k index selection (#38044)
Co-authored-by: BBuf <bbuf@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-05 18:12:30 +08:00
DayuxiaoshuiandXiaoyu Zhang 50c1bf0db0 [Diffusion] Port the Wan VAE decoder fast paths to the Qwen-Image VAE (#38020)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-09-05 18:02:33 +08:00
Xiaoyu ZhangandBBuf d49180019b fix(moe): cast filtered-activation expert_ids to int32 for torch.compile (#38085)
Co-authored-by: BBuf <bbuf@users.noreply.github.com>
2026-09-05 17:13:07 +08:00
Xiaoyu Zhang a74470e904 fix(mamba): unify causal_conv1d col* dtype to x (MiniCPM-V-4.6 GDN prefill bf16/fp16 mismatch) (#38039) 2026-09-05 17:08:20 +08:00
Ke Bao ae3205ba28 Fail fast on undersized swa pool (#37610) 2026-09-05 13:40:37 +08:00
09f542b23a [CI] Add /rerun-test --changed to rerun every test file a PR modifies (#37618)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-09-04 22:38:11 -07:00
Yash AkhauriandXiaoyu Zhang 756d0e0a85 [Model] Add K2 Horizon FP8 checkpoint support (#38033)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-09-05 13:18:26 +08:00
e980c1a2f1 fix(glm4v): disambiguate mixed image video offsets (#37971)
Co-authored-by: duxin <xinheng.dx@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-09-05 13:16:16 +08:00
Liangsheng Yin 0454c074b4 [mem_cache] Clean up unified allocator leftovers (#38103) 2026-09-04 22:02:50 -07:00
3a770da756 [Unified Tree] Support Branching-Point Caching for the SWA Component (#34565)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
2026-09-05 12:29:16 +08:00
Po-Han Huang (NVIDIA) 991368d880 Fix Muse Glimmer ModelOpt mixed weight mapping (#37510) 2026-09-04 20:53:55 -07:00
Liangsheng Yin d50e9a9756 [Test] Prune redundant unified-memory allocator and pool tests (#38093) 2026-09-04 20:47:01 -07:00
92a4d8b5ee Clean logging under --weight-loader-prefetch-checkpoints (#33930)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-09-04 20:05:53 -07:00
Liangsheng Yin 0645398a32 [mem_cache] Move the unified-memory allocators into allocator/ and split the composites out (#38072) 2026-09-04 19:53:15 -07:00
Niko MaandZhangheng f1f2380d2b [Unified Cache][6/N]: Add UMBP external linker (#37578)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-09-05 09:21:43 +08:00
55bf3380e0 Support Hy4-preview (#36805)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
2026-09-04 18:03:49 -07:00
3c2724c48d [AMD] Optimize Kimi-K3 Triton MLA prefill on gfx950 (#35770)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
2026-09-04 17:44:30 -07:00
Lianmin Zheng 613d87becd [Memory] Reuse output storage across full prefill CUDA graphs (#38038) 2026-09-04 17:23:31 -07:00
YAMY 65f7957142 fix: gather CP-sharded tokens before TP-sharded dense MLP under prefill CP (#38078) 2026-09-04 17:14:31 -07:00
Amy Chang 8a98f11078 [feature] Add response-level input/output token ids to chat completions via SglExt (#34488) 2026-09-04 16:45:13 -07:00
YAMY db89f639ef [GDN] Amortize ReplaySSM checkpoint materialization (#35544) 2026-09-04 15:13:20 -07:00
Yongji WuandLianmin Zheng fbf8f1dbf6 [Fix] Coordinate FullCG prefix variants across DP ranks (#37888)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-09-04 11:29:30 -07:00
Jialin OuyangandPranjal Shankhdhar 010dc955be [Metrics] Export scheduler stage wall time (#37636)
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
2026-09-04 10:45:53 -07:00
YAMY 07199fa220 [Performance] Optimize Qwen3.5 GDN prefill projection layouts (#36267) 2026-09-04 10:32:44 -07:00
huangtingweiandZhiqiang Xie 0d0e2f92be [HiCache] Buffer mode support sidecar pool (#37424)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2026-09-04 23:24:18 +08:00
8b1d8c1703 [Metrics] Add rolling scheduler utilization counters (#37461)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: pranjalssh <pranjalssh@fb.com>
2026-09-04 08:06:17 -07:00
4349538c02 [model] add cosmos3 reasoner to llm only inference (#33572)
Signed-off-by: joeltg <joel@reflection.ai>
Signed-off-by: Joe Rowell <joe@poolside.ai>
Co-authored-by: Dawid Majchrowski <dmajchrowski@nvidia.com>
Co-authored-by: Kedi Wu <kediw@nvidia.com>
Co-authored-by: Kedi Wu <31940276+kediwu0331@users.noreply.github.com>
Co-authored-by: Joel Gustafson <joelgustafson@protonmail.com>
2026-09-04 22:11:58 +08:00
Shuwen Wang 19b46863f3 fix: align write-through pending across tree cores (#37278) 2026-09-04 22:08:25 +08:00
hhhh1252023 dc6b5d1f5a [CI][NPU] Remove model tests from PR-test pipeline (#38011) 2026-09-04 21:26:52 +08:00
Shuwen WangandClaude Opus 5 e4adf63275 [Fix] Vacuous marker writes in the cache tests, and an undebited Mamba admission slot (#36415)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-04 19:43:17 +08:00
12735c2d76 [mm] refactor mm code for rust tokenizer manager (#34660)
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-09-04 03:03:25 -07:00