|
ddd4600197
|
[Fix] HiCache startup ImportError on the pinned kernel wheel (#39516)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-14 22:31:19 -07:00 |
|
|
Shuwen Wang
|
5298d85218
|
fix: stop shadowing the DSpark shared-experts fusion guard (#39366)
|
2026-09-14 22:24:49 -07:00 |
|
|
ashwini rathiandClaude Opus 4.7
|
b510881157
|
[Fix][Qwen-VL] Normalize <image> sentinel on artifact fast path (#39278)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-09-15 13:19:59 +08:00 |
|
|
|
6c514ab025
|
Force reasoning mode for GLM-5.3 chat templates (#39227)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-09-15 13:16:26 +08:00 |
|
|
Yanbin Jiang
|
ebd37705e4
|
[PD][LoRA] Gate decode admission on adapter slots (#39332)
|
2026-09-15 13:11:04 +08:00 |
|
|
ishandhanani
|
3f871a246c
|
feat(agent sessions): attribute stored KV cache blocks to sessions (#37482)
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-09-14 21:34:49 -07:00 |
|
|
Byron HsuandByron Hsu
|
c9fbe5f655
|
[MM] Add flag to force Kimi image preprocessing onto CPU (#39148)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
|
2026-09-14 21:19:39 -07:00 |
|
|
Aurick QiaoandAurick Qiao
|
5dde6e8f02
|
Fix MegaMoE buffer allocation and caching for effective SM budgets (#39223)
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-09-15 10:24:02 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
99060191e7
|
[KDA] Support ReplaySSM ring-write in the fused chain-verify kernel (#36821)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-09-15 10:22:41 +08:00 |
|
|
JoeandXiaoyu Zhang
|
a23fd557ed
|
[Kernel] Add OOT dispatch for clamp position (#38687)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-15 10:22:21 +08:00 |
|
|
Kan Wu
|
07e1918924
|
[Rust] Use Dynamo native renderers when chat templates are missing (#38939)
|
2026-09-14 17:29:10 -07:00 |
|
|
Xingyu Liu
|
8874c51a96
|
[Benchmark] Add an opt-out for the token-capacity check (#39284)
|
2026-09-14 17:17:12 -07:00 |
|
|
raghothamandLianmin Zheng
|
c0b8725f5a
|
Fix /model_info serialization when a config value is a class (#39237)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-09-14 17:10:44 -07:00 |
|
|
Yang Liuandyangliu991
|
276663a79d
|
[model-loader] Split weight loading from postprocessing (#34981)
Co-authored-by: yangliu991 <yangliu991@fb.com>
|
2026-09-14 17:10:19 -07:00 |
|
|
Lianmin Zheng
|
a2b4e8888f
|
Allow CUDA VMM feature transport with the Rust frontend (#39347)
|
2026-09-14 17:09:49 -07:00 |
|
|
faceless void
|
6e755e4114
|
[Logging] Downgrade missing TokenizerManager request state log to warning (#36625)
Signed-off-by: syd520zy <529477025@qq.com>
|
2026-09-14 16:18:56 -07:00 |
|
|
AMD-yanfeiwang
|
0163f8ff74
|
[AMD] Fix registered HiCache host pointer aliases (#35233)
|
2026-09-14 15:49:05 -07:00 |
|
|
Baizhou Zhang
|
2fca6d69aa
|
bumping sgl-deep-gemm to 0.2.0 (#39371)
|
2026-09-14 15:30:31 -07:00 |
|
|
cctry
|
dad8c074e7
|
Scope prefetch cache state to the request attempt (#39318)
|
2026-09-14 15:03:03 -07:00 |
|
|
Qiaolin Yuandehuaa
|
d72e59508b
|
Reland fix(qsa): clamp the compress gather to the rows (#38346) (#39446)
Co-authored-by: ehuaa <ehuamail1@gmail.com>
|
2026-09-14 14:05:41 -07:00 |
|
|
paulzhang-tm
|
9128d57966
|
[Spec] Allow speculative workers to stage prefill shared reads (#38554)
|
2026-09-14 14:03:27 -07:00 |
|
|
Byron HsuandByron Hsu
|
5c2de3f355
|
[PD] Preserve the prefill rank during rebootstrap (#39357)
Co-authored-by: Byron Hsu <byronhsu@users.noreply.github.com>
|
2026-09-14 09:20:37 -07:00 |
|
|
pllimax
|
7465e42b7a
|
[NPU][CI] Add CANN 9.1.0 and Ascend a5 nightly suites (#38833)
|
2026-09-14 22:39:42 +08:00 |
|
|
pllimax
|
433c999dd0
|
[NPU][CI] Fix sglang.test.ascend import failure in multi-node e2e pods (#39403)
|
2026-09-14 22:23:47 +08:00 |
|
|
Kurt Shuster
|
f81fbc749a
|
[Fix] Merge adjacent KV-row frees so a mid-page split under DCP cannot double-free (#38941)
|
2026-09-14 21:44:32 +08:00 |
|
|
Aurick QiaoandAurick Qiao
|
2123aca87e
|
[Fix] Wait for PDL before reading DeepSeek V4 K cache locations (#38409)
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-09-14 21:04:28 +08:00 |
|
|
iridiumine
|
87db743021
|
[NPU] Fix device mismatch in SWA mask for DSpark verify graph capture (#39353)
|
2026-09-14 19:36:33 +08:00 |
|
|
Liangsheng Yin
|
66c7bc838e
|
[misc] Revert #38346, #33426, #39061 and #39219 (#39405)
|
2026-09-14 03:04:07 -07:00 |
|
|
amd-danli103
|
5aa9b8fb3e
|
[AMD][DSV4] feat: enable fp8 two-pool unified_kv on gfx950 (#37413)
|
2026-09-14 02:49:11 -07:00 |
|
|
Jacob0226andThomas Wang
|
5200508b0f
|
[AMD][gfx95] Fill the chunked-prefill compute budget exactly (#32888)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-09-14 00:35:15 -07:00 |
|
|
|
3eeb7d37f9
|
[AMD] gfx950 assembly attention: length-aware split-KV for dynamic workload (#39172)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-13 23:48:03 -07:00 |
|
|
ZeyuanChen2000
|
a4781c9fe5
|
[NPU] Fix error due to missing parameter quant_linear passing (#37384)
|
2026-09-14 14:37:44 +08:00 |
|
|
Shuwen Wang
|
0d95a9c1ff
|
[HiCache] Keep the file backend temp file name within NAME_MAX (#38925)
|
2026-09-14 05:12:28 +00:00 |
|
|
Mohammad Miadh Angkadandmmangkad
|
2fd835b9c1
|
[Fix] Don't write conv state from the fused KDA verify kernel (#39219)
Co-authored-by: mmangkad <mohammad.angkad@radixark.ai>
|
2026-09-13 21:26:57 -07:00 |
|
|
Jan Bernlöhr
|
60f6f03409
|
Fix MUSA detection in compiled prefill path (#39061)
|
2026-09-13 21:23:51 -07:00 |
|
|
Kurt ShusterandBaizhou Zhang
|
f2111715cd
|
[fa] Make the FlashAttention backend extensible by subclasses (#33426)
Signed-off-by: Kurt Shuster <kurt@thinkingmachines.ai>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-09-13 21:21:25 -07:00 |
|
|
|
39e147443b
|
[Session] Fix image append positions and parent metadata (#39145)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Manik Singhal <manikvsinghal.pub@gmail.com>
|
2026-09-13 21:06:47 -07:00 |
|
|
Jackey Hua
|
5a132c061b
|
[Perf] trtllm_mla: reuse the fused fp8 KV/Q prepare on target verify (#39232)
|
2026-09-13 20:59:00 -07:00 |
|
|
|
42b5af8c62
|
[diffusion] docs: refresh the VDN-H3 on b200 numbers in cookbook (#39244)
Co-authored-by: haochengxi <xihc@berkeley.edu>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
|
2026-09-14 11:50:40 +08:00 |
|
|
sglang-botandsglang-bot
|
96a95171c7
|
chore: bump sglang-kernel version to 0.4.7 (#39346)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-09-13 20:49:37 -07:00 |
|
|
MickandMick Qian
|
3480112a9c
|
[diffusion] fix: serve requests that turn cfg off on a cfg-parallel server (#39303)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-14 11:26:37 +08:00 |
|
|
|
4c71d14fba
|
[HiCache][LoRA] Simplify decode offload hash inputs (#39162)
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
|
2026-09-14 11:23:31 +08:00 |
|
|
Chao ShiandZhangheng
|
bf9773e1da
|
HiCache: Add @rank_consensus to various functions (#37425)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-09-14 10:44:21 +08:00 |
|
|
Cheng Xin
|
ca8ecc6a6f
|
[NPU] Support DSV4 host memory cache management (#37382)
|
2026-09-14 10:38:50 +08:00 |
|
|
Cheng Wan
|
6410800af9
|
[unified-memory] Enable prefill cuda-graph capture (#37418)
|
2026-09-13 19:17:19 -07:00 |
|
|
Cheng Wan
|
2ec4bbcbd4
|
[unified-memory] PD disaggregation for every unified pool shape (#37506)
|
2026-09-13 19:16:43 -07:00 |
|
|
Kurkur
|
6388b6cfb1
|
[feat] Add base NpuSRTPlatform implementation (#36472)
|
2026-09-14 09:32:24 +08:00 |
|
|
sglang-botandsglang-bot
|
4358a1617c
|
chore: bump sgl-kernel version to 0.4.7 (#39324)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-09-13 15:48:50 -07:00 |
|
|
Baizhou ZhangandChunan Zeng
|
5ebb16005d
|
[DeepSeek-V4.1] Bump FlashMLA to the fork's rebase head (v4.1 kernels) (#39171)
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
|
2026-09-13 15:43:19 -07:00 |
|
|
Shuwen Wang
|
ff228d11fe
|
[HiCache] Release buffer prefetch anchor locks during storage cleanup (#38483)
|
2026-09-13 20:47:21 +00:00 |
|