 Carrie ChenandBrayden Zhong
|
6a5a9eccaa
|
add flashinfer cute-dsl backend for mxfp8 gemm (#34042)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-08-13 08:50:01 +08:00 |
|
|
Lukas Humbel
|
40eaf34428
|
fix: make automatic NUMA binding configurable (#30394)
|
2026-08-12 17:40:28 -07:00 |
|
|
Mohammad Miadh Angkad
|
aefe2d0207
|
Revert "[Kimi K3] Fuse MLA gate projection into QKV-A GEMM" (#34642)
|
2026-08-13 08:35:38 +08:00 |
|
|
|
bbda7f32b1
|
[AMD][CI] CI: fix AMD 2-GPU multimodal-gen partition-count abort (#34328)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
|
2026-08-13 08:32:33 +08:00 |
|
|
jthomson04
|
385903b0ac
|
feat: add cache salt support to KV cache events (#30827)
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
|
2026-08-12 16:14:04 -07:00 |
|
|
Khoa PhamandClaude Opus 5
|
6c6294b7be
|
[DCP] Fuse the a2a pack/unpack copies in the MLA LSE reduce (#34614)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-12 16:04:46 -07:00 |
|
|
Liangsheng Yin
|
c05eb856f7
|
[CI] Fix nightly test failures (#34523)
|
2026-08-12 15:40:20 -07:00 |
|
|
binbin Deng
|
2b4381956f
|
fix(glm5.2): restrict MoE weights to local PP layers (#33793)
|
2026-08-12 12:32:08 -07:00 |
|
|
elvischenv
|
4f883636a2
|
[Perf] FlashInfer MLA: remove blocking D2H in spec-decode plan (#27689)
|
2026-08-12 12:29:03 -07:00 |
|
|
|
773faf992d
|
Reserve multimodal runtime allocations and keep padded inputs aligned (#34141)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: wangwenchen0407 <wangwenchen@meta.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
|
2026-08-12 11:04:07 -07:00 |
|
|
|
b501311fa1
|
[Kimi K3] Fuse MLA gate projection into QKV-A GEMM (#33623)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-13 00:21:34 +08:00 |
|
|
yiheng
|
8549cce11b
|
[BugFix] Fix race in c128 prefill plan kernel on ragged extend (#32467)
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
|
2026-08-13 00:15:41 +08:00 |
|
|
Mick
|
ad47dde65c
|
[diffusion] optimize: fuse cosmos qk norm, rope, and kv packing (#34275)
|
2026-08-12 23:18:16 +08:00 |
|
|
McZyWu
|
197832bcf5
|
[Kimi-K3][NPU] Support Kimi-K3 on NPU (#33465)
|
2026-08-12 21:20:14 +08:00 |
|
|
Mick
|
dc5f6c4883
|
[diffusion] optimize: stream and parallelize bit-exact video output saves (#34564)
|
2026-08-12 20:03:37 +08:00 |
|
|
Mick
|
9701cc138c
|
[diffusion] optimize: optimize bit-exact h3 reference video ingress (#34563)
|
2026-08-12 20:02:49 +08:00 |
|
|
Mick
|
b3bffef70a
|
[diffusion] UX: suppress noisy worker startup warnings (#34512)
|
2026-08-12 17:53:45 +08:00 |
|
|
Mick
|
644d55ebfa
|
[diffusion] feat: support native and peft minimax h3 loras (#34359)
|
2026-08-12 17:52:40 +08:00 |
|
|
Mohammad Miadh Angkad
|
00e57d74f0
|
Bump FlashInfer to 0.6.17 and remove Kimi K3 workarounds (#33997)
|
2026-08-12 02:17:26 -07:00 |
|
|
Yuzhen Zhou
|
2d76d537e5
|
feat: support deterministic FA4 for GLM-4.7-Flash (#33945)
|
2026-08-12 16:57:34 +08:00 |
|
|
Xiaoyu Zhang
|
1f008dc226
|
[Diffusion][LTX-2] Allocate AdaLN outputs from one contiguous slab (#34508)
|
2026-08-12 16:28:27 +08:00 |
|
|
Xiaoyu Zhang
|
daae3acb36
|
[Diffusion][Z-Image] Tune native QK RMSNorm launch for SM103 (#34507)
|
2026-08-12 16:27:44 +08:00 |
|
|
Xiaoyu Zhang
|
4827061247
|
[Diffusion] Make weight-only FP8 dequant cache torch.compile-safe (#34506)
|
2026-08-12 16:26:31 +08:00 |
|
|
Xiaoyu Zhang
|
84ce7502cf
|
[Diffusion][MiniMax H3] Extend exact QKNorm+RoPE rounding to SM103 (#34505)
|
2026-08-12 16:25:24 +08:00 |
|
|
Xiaoyu Zhang
|
45f7063335
|
[Diffusion] Tune QK head LayerNorm for SM103 (#34503)
|
2026-08-12 16:24:18 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
a2e88279c2
|
metrics: don't clock-rebase unset time sentinels in ReqTimeStats deserialization (#34335)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-12 14:27:47 +08:00 |
|
|
Mohammad Miadh Angkad
|
0dab252ffc
|
Fix DFlash sliding attention causality defaults (#34524)
|
2026-08-11 23:05:55 -07:00 |
|
|
Xinyuan Tong
|
687967c70d
|
Fix tokenizer warning filtering for processors (#34500)
|
2026-08-11 22:26:44 -07:00 |
|
|
Liangsheng Yin
|
9d2d737ebf
|
[Benchmark] Remove 22 unmaintained benchmarks (#34520)
|
2026-08-11 22:24:43 -07:00 |
|
|
Juan MunetonandMa Mingfei
|
cac3269305
|
[XPU] Fix NemotronH (hybrid mamba2) launch on --device xpu (#32227)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-08-12 13:23:23 +08:00 |
|
|
Xiaoyu Zhang
|
22e4b3a81f
|
[Diffusion] Avoid slow cuBLASLt GELU epilogue on SM120 (#34350)
|
2026-08-12 12:12:00 +08:00 |
|
|
Mick
|
a9a355774a
|
[diffusion] feat: support dynamically cpu offload components (#34391)
|
2026-08-12 11:38:27 +08:00 |
|
|
+3
|
5899674504
|
[Fix] Make DeepSeek-V4 reasoning and tool-call streaming parsing chunk-invariant (#34458)
Co-authored-by: hao-cyber <89575785+hao-cyber@users.noreply.github.com>
Co-authored-by: Enrico Falco <enrico9034@gmail.com>
Co-authored-by: Svyatoslav <85786374+slivanovich@users.noreply.github.com>
Co-authored-by: Andreas Hassellof <andreas@ombori.com>
Co-authored-by: Leoyzen <leoyzen@gmail.com>
Co-authored-by: Chenglun Hu <chenglunhu@gmail.com>
Co-authored-by: robellliu-dev <robell.liu@huawei.com>
Co-authored-by: Gavin.Zhu <gavin.z@gmicloud.ai>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: tancheng33 <garrytancheng@gmail.com>
Co-authored-by: dineshx29 <dinesh.b.offl@gmail.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
|
2026-08-11 20:03:28 -07:00 |
|
|
Xiaoyu Zhang
|
4aff4b1822
|
[Diffusion] Improve bit-exact fusion fallback diagnostics (#34412)
|
2026-08-12 10:42:48 +08:00 |
|
|
Xiaoyu Zhang
|
3f9d184833
|
[Diffusion] Tune QK head LayerNorm for SM120 (#34349)
|
2026-08-12 10:41:54 +08:00 |
|
|
|
f7b6800b22
|
[diffusion] model: support cosmos3 edge and distilled (#31590)
Co-authored-by: Kedi Wu <31940276+kediwu0331@users.noreply.github.com>
Co-authored-by: Kedi Wu <kediw@nvidia.com>
|
2026-08-12 10:29:40 +08:00 |
|
|
NVShreyasandClaude Opus 4.8
|
30cb848d4b
|
[Bugfix][DSA] Fix num_splits "(b+1)" crash on prefill-CP speculative decode (#34443)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-08-11 19:13:49 -07:00 |
|
|
Xiaoyu Zhang
|
a53d3636ce
|
[diffusion][model] Add native SANA-Video T2V support (#32921)
|
2026-08-12 10:07:24 +08:00 |
|
|
zijiec
|
93e9db5eb8
|
[Fix][Qwen]: fused shared-expert detection PP-safe protection (#34447)
|
2026-08-11 18:50:05 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
37c631ef23
|
[diffusion] Ideogram-4: fuse Qwen3-style RoPE and SwiGLU silu-mul (denoise -5.1% H100 / -4.7% H200, bit-exact) (#34314)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-12 09:19:35 +08:00 |
|
|
Xiaoyu Zhang
|
b1b8ce715b
|
[Diffusion][MiniMax H3] Fix SM120 QKNorm+RoPE rounding (#34347)
|
2026-08-12 09:18:16 +08:00 |
|
|
Mick
|
a2d723820e
|
[diffusion] fix: fix model-driven dit layerwise offload auto policy (#34401)
|
2026-08-12 09:08:31 +08:00 |
|
|
Shu Wang
|
c7c03ec53b
|
[NVIDIA] Add flashinfer MNNVL backend for allreduce only (#30700)
|
2026-08-11 16:46:46 -07:00 |
|
|
Baizhou Zhang
|
983dfd6a9a
|
[Misc] Sanitize the structure of environ.py (#34472)
|
2026-08-11 16:31:33 -07:00 |
|
|
|
d82a1d4802
|
[XPU] Pad MoE expert weight row stride to avoid L3 aliasing (#33905)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-11 15:54:13 -07:00 |
|
|
|
fde9ad2531
|
[Feature] Add Muse Glimmer model support (#34262)
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-08-11 15:41:52 -07:00 |
|
|
Hanming Lu
|
9c1517df4a
|
Raise PD zmq per-context socket cap via SGLANG_DISAGGREGATION_ZMQ_MAX_SOCKETS (#34450)
|
2026-08-11 15:27:32 -07:00 |
|
|
Mohammad Miadh Angkad
|
7fb6e61b95
|
Fix CUDA 13.0 VMM handle type compatibility (#34431)
|
2026-08-11 15:16:34 -07:00 |
|
|
ilyasher-harmonic
|
9ced8d0981
|
Optimize FP32 LM head for bf16/fp16 (#32370)
|
2026-08-11 15:14:50 -07:00 |
|
|
gongwei1027
|
2c07ca5e8d
|
[Fix] Allow flashinfer_sparse_mla DSA backend for HiSparse on SM120 FP8 KV (#33075)
|
2026-08-11 15:05:04 -07:00 |
|