Liangsheng Yin
|
e5c46ff07d
|
[Fix] Route asymmetric-KV models to fa4 on SM100 and pin MiMoV2 FP8 MoE to flashinfer_trtllm (#32818)
|
2026-07-29 16:37:43 -07:00 |
|
cctry
|
3c1717d9b6
|
Follow up on #30157 post-merge review (#32672)
|
2026-07-29 15:03:59 -07:00 |
|
Sam (Kesen Li)
|
8fc54d46ef
|
Fix MoE reduce-scatterv eligibility check (#32663)
|
2026-07-29 14:58:55 -07:00 |
|
Rain Jiang
|
d24de56995
|
sglang rust server sampling message (#32343)
|
2026-07-29 14:55:06 -07:00 |
|
 Willow LopezandJiminator
|
ffd4705baa
|
fix(reasoning): honor Poolside template thinking defaults (#32540)
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com>
|
2026-07-29 21:02:19 +00:00 |
|
Sam Shleifer
|
d0e69d3881
|
[feat] Optional base64 encoding for the flat prompt top logprob arrays (#31960)
|
2026-07-29 12:15:56 -07:00 |
|
 
|
e4f7f7b380
|
fix(qwen3.5): restrict MoE weights to local PP layers (#32022)
Co-authored-by: chunjiang.hc <chunjiang.hc@alibaba-inc.com>
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
|
2026-07-29 12:01:09 -07:00 |
|
Ke Bao
|
f73d6f2789
|
Update Inkling cookbook install command (#32799)
|
2026-07-30 02:23:23 +08:00 |
|
Rain Jiang
|
2ca2ca753a
|
sglang rust server request message (#32242)
|
2026-07-29 10:54:56 -07:00 |
|
 ziang663andChao Shi
|
eefb434d17
|
[PD+PP] Honor PP consensus for bootstrap and prealloc (#31869)
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
|
2026-07-30 01:19:17 +08:00 |
|
Yoray Zack
|
62d0f81f16
|
[2/N] elastic-ep: Enable EPLB after scale-up (#30553)
|
2026-07-30 01:06:56 +08:00 |
|
Piotr Mazurek
|
d19999b755
|
[LFM2] Wire Lfm2MoeForCausalLM into the LFM2 serving override tables (#30780)
|
2026-07-29 17:02:14 +00:00 |
|
 Hert4andMohammad Miadh Angkad
|
f69af7b7ad
|
[Bugfix] compressed-tensors: mixed-precision checkpoints silently load unquantized (#32736)
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-07-29 09:55:33 -07:00 |
|
YAMY
|
fddfc1fb5e
|
[GDN] Support FlashInfer GDN prefill with extra-buffer radix cache (#29735)
|
2026-07-30 00:47:35 +08:00 |
|
 huangtingweiandalphabetc1
|
50029f05a3
|
[HiCache] Merge HiCache event checks to reduce decode overhead (#30511)
Co-authored-by: alphabetc1 <47200617+alphabetc1@users.noreply.github.com>
|
2026-07-29 23:48:48 +08:00 |
|
Bingxu Chen
|
bfc450248e
|
[AMD] Replace MI325 with MI300 CI Runners (#31409)
|
2026-07-29 08:18:07 -07:00 |
|
Nicolas Castet
|
e1f2f9d1fa
|
Disable extra NCCL CUDA event synchronization with symm mem (#27089)
|
2026-07-29 22:39:36 +08:00 |
|
Ke Bao
|
3763d3fa8c
|
Add decode-lock skip to compute-mamba-ratio (#32789)
|
2026-07-29 22:38:34 +08:00 |
|
Wu Jiangming
|
1c6a0e91e1
|
fix mqa preshuffle layout issue for deepseek v4 (#31563)
|
2026-07-29 07:36:48 -07:00 |
|
Mick
|
22151edca1
|
[diffusion] optimization: accelerate CUDA video output finalization (#32784)
|
2026-07-29 22:04:20 +08:00 |
|
Xiaoyu Zhang
|
0ebbe43dbb
|
fix(diffusion): size VSA top-k from padded blocks (#32695)
|
2026-07-29 21:58:41 +08:00 |
|
Xiaoyu Zhang
|
4f5b50c576
|
perf(diffusion): decode Wan VAE in BF16 (#32697)
|
2026-07-29 21:57:50 +08:00 |
|
Xiaoyu Zhang
|
917e900d4d
|
feat(diffusion): add regional torch compile (#32696)
|
2026-07-29 21:57:05 +08:00 |
|
Ke Bao
|
50b029257f
|
Skip mamba lock during decoding (#32228)
|
2026-07-29 21:53:28 +08:00 |
|
pllimax
|
d004a15a3e
|
Fix GLM4-7B-Flash accuracy test configuration, tune Qwen3.6-27B/35B performance test parameters, and harden Ascend NPU multi-node E2E test utilities against pod name format errors. (#32371)
|
2026-07-29 21:44:17 +08:00 |
|
Ilia Yastrebov
|
977f04aafe
|
[PD] NIXL connector: shard by destination (#32025)
|
2026-07-29 21:02:13 +08:00 |
|
 MickandClaude Sonnet 5
|
67c2258906
|
[diffusion] fix: fix dual-DiT models crash with (1,)-placeholder weights after compile-time offload (#32743)
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-07-29 20:44:13 +08:00 |
|
JiaruiChang5268
|
ca6e0ff2c8
|
[NPU] fix dsv4 mtp condition on NPU graph (#32711)
|
2026-07-29 20:13:31 +08:00 |
|
Yi (Vincent) Zhong
|
d254ec9ff8
|
Add LFM2.5 embedding model support (#28691)
|
2026-07-29 11:58:47 +00:00 |
|
LZW
|
4c82bb3252
|
Add Mooncake tenant id support (#30256)
|
2026-07-29 18:17:41 +08:00 |
|
 Xiaoyu ZhangandClaude Fable 5
|
8742a1a0f8
|
Add a benchmark script for the HPC-Ops bf16xfp32 router GEMM (#32642)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-29 18:17:08 +08:00 |
|
Ke Bao
|
c151080d28
|
Add compute-mamba-ratio skill (#32763)
|
2026-07-29 18:15:48 +08:00 |
|
Baizhou Zhang
|
d12ea3e9ba
|
docker: add Kimi K3 images (#32760)
|
2026-07-29 03:02:28 -07:00 |
|
 hunhokimandHun-ho Kim
|
983e4aa18d
|
Eliminate redundant DSA state transfers (Mooncake) (#32620)
Co-authored-by: Hun-ho Kim <hunho.kim@samsung.com>
|
2026-07-29 17:58:48 +08:00 |
|
 Xinyu JiangandZhiyao Jiang
|
f5bcd00e16
|
[AMD] DSv4: bring HIP compress-state pool into the memory_saver KV_CACHE region (#31747)
Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
|
2026-07-29 02:41:08 -07:00 |
|
Xiaoyu Zhang
|
c32c4ef79c
|
[Kernel] Move sgl-kernel under sglang.kernels.aot (#32648)
|
2026-07-29 17:25:00 +08:00 |
|
Mohammad Miadh Angkad
|
1b9dfa14e6
|
Fix FlashInfer MNNVL workspace size check (#32318)
|
2026-07-29 02:12:18 -07:00 |
|
Junlin Wu
|
9ab88380c1
|
👥 chore(codeowners): Update codeowners for NPU quantization (#31917)
|
2026-07-29 12:10:01 +03:00 |
|
Yihao Wang
|
227dadd79a
|
[diffusion] feat: support resident layers for DiT (#31538)
|
2026-07-29 16:52:55 +08:00 |
|
 Andrew KuksaandANDREW_K
|
0caf0fc01d
|
[Diffusion][Docs] Ascend A2, A3 add basic usage and benchmark results in diffusion cookbook (#30614)
Co-authored-by: ANDREW_K <andrewsha3@DESKTOP-KNDINTT.localdomain>
|
2026-07-29 11:50:15 +03:00 |
|
 Brayden ZhongandBrayden Zhong
|
7dcebca255
|
Fix nightly CI: NVFP4 cuda-graph crash, NVILA batching, CuTe paged-KV zero-size, Kimi-VL OOM (#32118)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-29 01:39:55 -07:00 |
|
Liangsheng Yin
|
cce5873513
|
[CI] Fail lint when a registered file's TestCase classes never run (#32735)
|
2026-07-29 00:45:01 -07:00 |
|
 
|
f05c92fb6d
|
✨ [llm][npu][quant] Add W8A8 MXFP8 quantization for Qwen3 MoE on Ascend NPU (#30768)
Co-authored-by: Артем Савкин <58187114+OrangeRedeng@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-29 10:39:36 +03:00 |
|
Mick
|
da5528db30
|
fix(vlm): materialize Qwen3-VL features on the vision device (#31596)
|
2026-07-29 15:25:04 +08:00 |
|
 weireweireandweireweire
|
bd47ec97ff
|
[EAGLE] Handle NaNs in fused top-k=1 (#32396)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-07-29 00:07:42 -07:00 |
|
 Jyothirmai KottuandMick
|
7c248dde7f
|
[diffusion] fix: don't self-kill diffusion worker when PID 1 is the real parent (#31361)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-07-29 14:35:56 +08:00 |
|
siweil
|
9bdbb180b1
|
[Disagg][NIXL] Fix heterogeneous attn-TP KV transfer for replicated GQA heads (NIXL_ERR_NOT_FOUND) (#31968)
|
2026-07-29 14:13:23 +08:00 |
|
 
|
ef6c07008b
|
Support DCP for Kimi Linear model (#32612)
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
|
2026-07-28 22:59:58 -07:00 |
|
Liangsheng Yin
|
c4fc241fd3
|
[Perf] Free KV pages by segment in the paged allocator without a device sync (#32701)
|
2026-07-28 22:24:16 -07:00 |
|
Xun Sun
|
bf6e80718a
|
[Elastic EP] fix previously flaky test of test_mooncake_ep_small.py (#31706)
|
2026-07-29 13:14:12 +08:00 |
|