 cctry
|
096551eed6
|
Make CUDA graph disabling PD-role-aware (prefill/decode) (#30409)
|
2026-07-08 15:08:22 -07:00 |
|
|
|
07ef650ef7
|
[AMD] Fix GLM-5.2 MTP Quark excludes (#30265)
Co-authored-by: zhaolin <zhaolin@amd.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-07-08 14:57:10 -07:00 |
|
|
Lianmin Zheng
|
ca8f15cd70
|
Fix FlashInfer A2A IMA by DP-synchronizing the decode graph bucket (#30242) (#30450)
|
2026-07-08 14:34:49 -07:00 |
|
|
Liangsheng Yin
|
10e7f2925f
|
[Fix] Chain the seq_lens publish event records so prebuilt seeding keeps the forward fence (#30435)
|
2026-07-08 13:43:09 -07:00 |
|
|
Xinyuan TongandEazyReal
|
45019b56ce
|
[Bugfix] Map reasoning_effort=low to Nemotron-3 Super low_effort + warn on unsupported levels (#30463)
Co-authored-by: EazyReal <8047065+EazyReal@users.noreply.github.com>
|
2026-07-08 12:19:44 -07:00 |
|
|
sonle5andsunxxuns
|
8d2b66fd90
|
Fix gfx95 bpreshuffle FP8 activation scale layout (#29275)
Co-authored-by: sunxxuns <126995791+sunxxuns@users.noreply.github.com>
|
2026-07-08 10:55:09 -07:00 |
|
|
Mohammad Miadh Angkad
|
04e4fadff3
|
Use FP32 logits in MoEGate fallbacks (#30323)
|
2026-07-08 23:43:45 +08:00 |
|
|
Xiaoyu Zhang
|
b8ca06fdad
|
Fix zero expert routed ids for MoE backends (#30387)
|
2026-07-08 21:23:25 +08:00 |
|
|
shuwenn
|
108a183f6b
|
[mem_cache][6/N] refactor: move MHA host-pool into pool_host/mha.py (#30249)
|
2026-07-08 20:12:52 +08:00 |
|
|
Jimmy ShongandClaude Opus 4.8
|
4c5fe42be4
|
[DSA] Fix IMA in fused top-k v2: write all output slots on tie overflow (#30512)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-08 19:49:26 +08:00 |
|
|
HuangJi
|
3d96bb9721
|
[diffusion] chore: rename lingbot world v2 (#30518)
|
2026-07-08 19:06:44 +08:00 |
|
|
jacky.cheng
|
96368a5f77
|
[AMD] Fuse shared-expert sigmoid + bf16->fp32 cast into the MoE append kernel (3 kernels -> 1) (#28658)
|
2026-07-08 02:34:20 -07:00 |
|
|
YAMY
|
8a868f8c00
|
[NVIDIA] Allow modelopt_mixed quantization with flashinfer_cutedsl MoE runner (#30443)
|
2026-07-07 23:50:52 -07:00 |
|
|
Mohammad Miadh Angkad
|
fda87173ab
|
Revert "Increase the KV cache pool when using indexShare by 15% (#30310)" (#30472)
|
2026-07-07 23:48:35 -07:00 |
|
|
|
33c3dfd7e0
|
[diffusion] Enable breakable CUDA graph (BCG) for diffusion DiTs (#27436)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: BBuf <bbuf@sglang.local>
|
2026-07-08 14:45:48 +08:00 |
|
|
amote-i
|
c9303a08da
|
Fix scheduler crash on prefill-unreachable decode abort (#29834)
|
2026-07-08 14:06:37 +08:00 |
|
|
Cheng Wan
|
7709a1f358
|
[refactor] ctx.resources: named slots, stream leases, and workspace buffer leases (#30348)
|
2026-07-07 21:30:10 -07:00 |
|
|
Cheng Wan
|
b7cca0bf8f
|
[refactor] Collect MoE and DP-attention runtime state into typed flag groups (#30347)
|
2026-07-07 21:29:27 -07:00 |
|
|
Cheng Wan
|
be32c57598
|
[refactor] Read resolved config from server_args fields; retire the flags mirror tier (#30346)
|
2026-07-07 21:28:34 -07:00 |
|
|
Cheng Wan
|
b14f7b4f75
|
[refactor] Move model-capability adjustments into the resolution pipeline (#30299)
|
2026-07-07 21:26:55 -07:00 |
|
|
Rahul VijayaraghavanandMa Mingfei
|
d4963f5c55
|
Fix prefill CUDA graph disabled for deeply-nested multimodal models (#30006)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-07-08 12:11:58 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
455ab36eeb
|
Increase the KV cache pool when using indexShare by 15% (#30310)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-07 20:59:13 -07:00 |
|
|
weireweireandweireweire
|
c7ca332fb0
|
Fix DSV4 prefill large Triton recompilation idle across context lengths (#30255)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-07-07 20:35:33 -07:00 |
|
|
Baizhou Zhang
|
fa278a762c
|
Fix FA3 prefill CP NaNs (#30439)
|
2026-07-07 20:16:09 -07:00 |
|
|
Alison Shao
|
f3c3eea608
|
ci: make multi-GPU jit test hangs attributable from the CI log (#29925)
|
2026-07-07 19:56:32 -07:00 |
|
|
|
7bc343470f
|
[Spec] DFlash: support pure-MLA targets with an fp8 KV cache (Kimi-K2.x-NVFP4) (#29218)
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-07 19:52:14 -07:00 |
|
|
HuangJi
|
db40fd83d2
|
[diffusion] model: support LingBot-World 2.0 (#30361)
|
2026-07-08 10:42:50 +08:00 |
|
|
Yihao WangandClaude Opus 4.8
|
68901ba387
|
[diffusion] Support SP for Krea-2 (#29777)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-07 19:39:00 -07:00 |
|
|
Yuchen Tian
|
9f5948c391
|
feat(mem_cache): add client-side metadata cache for HiCacheFile storage (#29716)
|
2026-07-07 18:21:46 -07:00 |
|
|
Yuwei AnandClaude Opus 4.8
|
49109d4267
|
[Tiny] Fix Import Error for Pure TP config with flashinfer_mxfp4 (#30426)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-07 18:17:52 -07:00 |
|
|
Chi McIsaacandMick
|
fa185ed84d
|
[diffusion] fix: fix z-Image accuracy (#29742)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-07-08 09:08:32 +08:00 |
|
|
|
d7dcdf3efd
|
[DSV4] perf: Make FP8 quant output tensor contiguous (#27926)
Co-authored-by: liqichao <liqichao@baidu.com>
Co-authored-by: chenbong <bhchen@stu.xmu.edu.cn>
|
2026-07-07 17:40:59 -07:00 |
|
|
YAMY
|
48ad6a83cf
|
[DeepSeek-V4] Enable non-paged indexer by default for large prefill chunks (#30140)
|
2026-07-07 15:51:24 -07:00 |
|
|
Alex NailsandClaude Opus 4.7
|
3d2e7cc601
|
[gRPC] Native server: launcher + HTTP + server args wiring (3/4) (#23508)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-07-07 14:57:25 -07:00 |
|
|
Qiaolin Yu
|
801571e949
|
[spec decoding] support rejection sampling in multi layer eagle (#30303)
|
2026-07-07 14:50:24 -07:00 |
|
|
Wang, FangYuan
|
40a68521c9
|
[AMD] Fix DeepSeekV4 server cutlass error (#30374)
|
2026-07-07 14:43:05 -07:00 |
|
|
|
bbc537035a
|
[DSA] Re-enable fused top-k v2 for MTP: clamp padded-row seq_lens to >= 0 (#30378)
Co-authored-by: ziyi.xu <ziyi.xu@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-07 13:44:01 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
6875df3378
|
[Cherry pick to release/v0.5.15] Fix NVILA weight loading (#30400)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-07 13:21:55 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
e2ea7aafad
|
[Cherry pick to release/v0.5.15] Fix NVFP4 online quantization (#30397)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-07 13:20:36 -07:00 |
|
|
cctry
|
2ad9a243f5
|
Size KV pool after CUDA graph capture (opt-in) (#30157)
|
2026-07-07 12:05:01 -07:00 |
|
|
Jzz1943andYihao Wang
|
11cea29c90
|
[diffusion][cache-dit] add dual-transformer Cache-DiT adapter specs (#30150)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
|
2026-07-07 08:10:52 -07:00 |
|
|
|
e339c83f82
|
[Model] Support LongCat 2.0 FP8 (#30275)
Co-authored-by: sunjiaqi11 <sunjiaqi11@meituan.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-07-07 19:51:12 +08:00 |
|
|
loading66
|
efdf02a38a
|
[NPU]Add support --pre-warm-nccl (#30312)
|
2026-07-07 17:17:29 +08:00 |
|
|
Jialin Ouyang
|
7fdc1cef17
|
[fix] Fix two trunk test regressions due to flexkv change (#29701) (#30372)
|
2026-07-07 16:58:45 +08:00 |
|
|
Rita Brugarolas
|
9ddea8d9ef
|
[AMD] [MORI-EP] Skip LocalExpertCount kernel in decode graph when not recording (#30302)
|
2026-07-07 01:07:07 -07:00 |
|
|
linhu-nv
|
50aa97da45
|
Feat/flexkv main connector (#29701)
|
2026-07-07 15:35:52 +08:00 |
|
|
Wang, FangYuan
|
9a6f8e5992
|
[AMD] Fix DeepSeek V4 MTP accuracy issue (#30333)
|
2026-07-06 23:57:57 -07:00 |
|
|
|
669fd4b8a5
|
[PP] Fix start_layer_id with pp in get kv_buffer_shape (#29887)
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-07-07 14:54:38 +08:00 |
|
|
|
fefc1743a9
|
Cute-DSL FP8 MQA logits (#25220)
Co-authored-by: Mindy Li <11663212+limin2021@users.noreply.github.com>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-06 23:34:07 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
1da7d3a50b
|
[MoE] Retire the AOT moe_fused_gate / kimi_k2_moe_fused_gate gate kernels (#26771) (#29997)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-07 13:53:17 +08:00 |
|