|
9cf157c252
|
[Radix Cache] Add Rust TreeCore backend with shared parity tests (#32710)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-09-01 00:26:20 +08:00 |
|
|
Xiaoyu Zhang
|
52e1c24744
|
[Diffusion] Fuse FLUX.2 token concatenation and NVFP4 quantization (#37141)
|
2026-08-31 21:33:02 +08:00 |
|
|
Xiaoyu Zhang
|
771e613d96
|
[Diffusion] Fuse Qwen-Image final adaptive LayerNorm (#37144)
|
2026-08-31 18:22:20 +08:00 |
|
|
Xiaoyu ZhangandCursor
|
1ed9bfac2c
|
[Diffusion] Fuse Qwen-Image FP8 norm and activation quantization (#37156)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-31 18:19:42 +08:00 |
|
|
pllimax
|
a874b83c2c
|
test: re-enable DSV4-Flash W8A8 8p nightly perf cases (#37214)
|
2026-08-31 17:20:46 +08:00 |
|
|
pllimax
|
63b2adbeac
|
[NPU] Fix evalscope accuracy parsing and add glm5_1 aime26 request timeout (#36459)
|
2026-08-31 17:19:03 +08:00 |
|
|
|
6580d5cd9a
|
weight cache: key daemon paths by GPU UUID (#36101)
Co-authored-by: siyu <liusy58@linux.alibaba.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-31 01:44:45 -07:00 |
|
|
+1
|
3865efc9f7
|
[AMD] support gfx1250 on ROCM 10 (#36871)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Kao <akao@amd.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: sogalin_codegen <39478626+sogalin@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-08-31 01:19:11 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
712a720c8a
|
[KDA] Fused-accept state advance for FlashInfer KDA MTP verify (#33722)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-08-31 16:11:49 +08:00 |
|
|
Cheng Wan
|
f61bb7b40a
|
[unified-memory] Drop the vacated 'dense' qualifier and the restating comments (#37170)
|
2026-08-31 00:54:13 -07:00 |
|
|
|
8bb776dc48
|
feat(unified-memory): read unified pool from attention backends fa3/flashinfer/trtllm_mha/flashmla (#34613)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-08-30 23:58:24 -07:00 |
|
|
|
29578d5578
|
refactor(unified-memory): translate the KV write location once, at ForwardBatch construction (#35245)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-08-30 23:52:14 -07:00 |
|
|
Ziang Li
|
4f997a432a
|
test: re-enable FlashInfer per-token NVFP4 coverage (#36985)
|
2026-08-30 23:44:09 -07:00 |
|
|
Lianmin ZhengandMing Yang
|
3ed3326631
|
Decouple speculative draft capacity from runtime state (#36897)
Co-authored-by: Ming Yang <minos.future@gmail.com>
|
2026-08-30 23:31:25 -07:00 |
|
|
YAMYandgithub-actions[bot]
|
b77cac06a9
|
[PP] Support prefill CUDA graph proxy tensors (#36248)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
|
2026-08-30 23:11:45 -07:00 |
|
|
Zhanghengand晟海
|
5d92e60783
|
[Unified Cache Linker][3/N]: Add backend-independent linker core (#37151)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-08-31 14:07:39 +08:00 |
|
|
ashwini rathi
|
10b67aa7a1
|
xpu: move prefill-only model tests to the nightly-xpu-1-gpu grid (#36814)
|
2026-08-31 14:03:48 +08:00 |
|
|
Liangsheng Yin
|
3a6ed55999
|
[Fix] Shut hicache test servers down gracefully before SIGKILL (#37194)
|
2026-08-30 22:45:40 -07:00 |
|
|
Liangsheng Yin
|
5d12ad4fd7
|
[mem_cache] Move mamba state and retraction_backup into ReqKvInfo (#37164)
|
2026-08-30 22:03:01 -07:00 |
|
|
Aurick Qiao
|
9a9e167179
|
[Bugfix] Fix full prefill CUDA graph padding and EAGLE capture (#35588)
|
2026-08-30 21:30:24 -07:00 |
|
|
YAMY
|
2ea6d17eab
|
fix(staging): make empty staging rings reusable (#37166)
|
2026-08-30 20:59:57 -07:00 |
|
|
Shuwen Wang
|
62f86ce470
|
[CI] Fix unreachable FakeReq field initialization (#37182)
|
2026-08-30 20:51:40 -07:00 |
|
|
Pavan Sivaram GirijalaandYanbingJiang
|
4dc7dc8518
|
[Fix] Transformers-fallback (GPT-NeoX) + KV pool config (DeepSeek-VL2) (#35244)
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
|
2026-08-31 11:05:50 +08:00 |
|
|
Mohammad Miadh Angkad
|
4f761e8649
|
[Deps] Bump FlashInfer to 0.6.18 (#36954)
|
2026-08-30 19:02:39 -07:00 |
|
|
Ali Ihsan Nergiz
|
0da6a66856
|
[MLX] Fix startup crash when reporting preloaded weights (#37035)
|
2026-08-30 17:36:13 -07:00 |
|
|
Xiaoyu Zhang
|
bb5e619860
|
[diffusion] perf: absorb Qwen-Image output projection biases (#37116)
|
2026-08-31 08:25:37 +08:00 |
|
|
Liangsheng Yin
|
4bb8de34cc
|
[mem_cache] Share one ReqKvInfo between a streaming session slot and its request (#37108)
|
2026-08-30 16:36:48 -07:00 |
|
|
|
4bea51d885
|
feat(unified-memory): dense KV views for uniform-row MHA/SWA models (#34602)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-08-30 15:10:12 -07:00 |
|
|
Liangsheng Yin
|
007ef5e23a
|
[mem_cache] Move req_pool_idx into ReqKvInfo (#37094)
|
2026-08-30 14:46:21 -07:00 |
|
|
Yuzhen ZhouandJiajun Li
|
8a87079dbb
|
Fix stale GLM MoE routing after runtime weight updates (#35883)
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
|
2026-08-30 14:13:34 -07:00 |
|
|
Xiaoyu Zhang
|
5ab97c4f44
|
[Diffusion] Cache Qwen-Image modulation across serial CFG branches (#37090)
|
2026-08-31 01:40:29 +08:00 |
|
|
Xiaoyu Zhang
|
8c28cdd116
|
[Diffusion][Kernel] Fuse Wan2.2 NVFP4 bias + GELU on Blackwell (#37075)
|
2026-08-31 01:37:35 +08:00 |
|
|
YAMY
|
9a03bc2dc3
|
[CI] Fix stale GPU capability test patches (#37148)
|
2026-08-30 10:12:32 -07:00 |
|
|
Zhanghengand晟海
|
6a9366f036
|
[Unified Cache Linker][2/N]: Add device pool assembly for external linkers (#37098)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-08-30 23:54:00 +08:00 |
|
|
Zhanghengand晟海
|
c9eb475a88
|
[Unified Cache][1/N]: Support cache contract for external linker (#37091)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-08-30 22:24:13 +08:00 |
|
|
Mick
|
e6a6492057
|
[vlm] fix: preserve per-request vit graph metadata for qwen-vl (#37043)
|
2026-08-30 21:02:14 +08:00 |
|
|
Mick
|
26c754e06e
|
[vlm] fix: recover multimodal decode and processor failures (#36983)
|
2026-08-30 20:50:19 +08:00 |
|
|
Cheng WanandClaude Opus 5
|
e51a3ae65e
|
[Config] Round 5.2: the per-model declarations get their own modules (#37087)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-30 02:24:35 -07:00 |
|
|
Cheng Wan
|
7e751153eb
|
[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)
|
2026-08-30 02:18:33 -07:00 |
|
|
Jason Wiemels
|
e635577431
|
[rotary] Fix the fused Qwen3.5 RoPE kernel discarding mrope height and width (#34446)
|
2026-08-30 15:37:40 +08:00 |
|
|
Oguz Ulgen
|
d249672ad3
|
Scatter mm embeddings with row index_copy_ instead of masked_scatter_ to cut transient GPU memory (#37070)
|
2026-08-30 00:15:39 -07:00 |
|
|
Liangsheng Yin
|
5ec959965b
|
[mem_cache] Settle extend kv_committed_len inside alloc_for_extend (#37085)
|
2026-08-29 23:14:31 -07:00 |
|
|
Liangsheng Yin
|
0438b16154
|
[mem_cache] Move kv_committed_len into ReqKvInfo (#37078)
|
2026-08-29 22:42:25 -07:00 |
|
|
EchO
|
5b7c62d5d6
|
fix(frontend): bound stop strings and regex patterns (#37029)
|
2026-08-29 22:25:26 -07:00 |
|
|
Alex Nails
|
78fa921189
|
[ROCm] Fix QuickReduce fp16 saturation corrupting bf16 all-reduces (106M non-finite -> 0, +0.3%) (#34484)
|
2026-08-29 22:08:17 -07:00 |
|
|
Liangsheng Yin
|
6be767c2d2
|
[mem_cache] Move cache_protected_len and swa_evict_floor into ReqKvInfo (#36982)
|
2026-08-29 19:37:53 -07:00 |
|
|
|
ed39568e79
|
[MoE] Add extension points for custom runner backends (#32665)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-29 19:03:41 -07:00 |
|
|
EchOandGuanyi Chen
|
ca8ff035c3
|
fix(hicache): isolate decode offload state per request (#37026)
Co-authored-by: Guanyi Chen <939416532@qq.com>
|
2026-08-29 18:15:05 -07:00 |
|
|
Liangsheng Yin
|
9a489f8d2f
|
[Test] Move gpqa and aime25 onto sgl-eval, drop unused eval paths (#36979)
|
2026-08-29 17:36:13 -07:00 |
|
|
Alex NailsandClaude Opus 5
|
00fbb6e8ac
|
[Perf] Tune the W4AFP8 DeepEP low-latency requant launch geometry (#35760)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-29 16:03:01 -07:00 |
|