Alex Nails and Claude Opus 5
68575b23d0
[CI] Stop the config ratchets re-parsing the package on every scan ( #36240 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-24 18:22:32 -07:00
pllimax
d2d8ecea77
[npu] Combine NPU test fixes from #35472 and #34516 ( #36180 )
2026-08-25 09:00:40 +08:00
huangtingwei
0f7ba3d115
[HiSparse] Support hisparse multi-step swap io kernel ( #32162 )
2026-08-24 17:29:44 -07:00
Alex Nails and Claude Opus 5
1ec20fd25d
[CI] Stop the resolution ratchets re-parsing the whole package ( #36235 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-24 16:55:35 -07:00
effe0d14d2
[Fix] Keep the MiniCPM-SALA config reads visible to the resolution ratchets ( #36178 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
Co-authored-by: Alex Nails <alex.nails@radixark.ai >
2026-08-24 16:05:09 -07:00
BingjiaWang
3c481b9421
[Benchmark] Add optional steady-state window for serving metrics ( #30918 )
2026-08-24 14:49:20 -07:00
AMD-yanfeiwang
24bce93c93
[AMD][MORI] Deduplicate CP-replicated state transfers ( #36025 )
2026-08-24 14:43:52 -07:00
jacky.cheng
0665740953
[AMD][Fix] Route MoRI through the Qwen MoE all-to-all path ( #32039 )
2026-08-24 13:04:08 -07:00
Ke Bao
586211bc46
Add PD test for inkling with mxfp8 KV ( #35840 )
2026-08-25 00:12:05 +08:00
Ke Bao
54ec2c4699
Fix recurrent state loss on decode retraction ( #35957 )
2026-08-25 00:11:05 +08:00
fzyzcjy
e586a6f2c5
Report the whole server's world size in the scheduler's internal state ( #35929 )
2026-08-24 20:21:45 +08:00
fzyzcjy
6dd79576cd
Expose the declared sglang env vars of a scheduler in its internal state ( #35928 )
2026-08-24 20:20:29 +08:00
fzyzcjy
c56cee0f80
Support gated launch to defer startup memory allocation ( #35927 )
2026-08-24 20:19:45 +08:00
fzyzcjy
3b24d8981b
Report per-token weight-version spans in generation meta info ( #35926 )
2026-08-24 20:18:52 +08:00
fzyzcjy
981dfa2b83
Make the scheduler track the published weight version ( #35925 )
2026-08-24 20:17:50 +08:00
Hert4 and Alex Nails
b4bd5f91ee
[diffusion] Fix test_model_fast_paths import after sana_ln_modulate rename ( #36175 )
...
Co-authored-by: Alex Nails <alex.nails@radixark.ai >
2026-08-24 04:48:17 -07:00
guzekai01
716a6bf10c
feat(humming): support native W4AFP8 checkpoint schemas ( #32033 )
2026-08-24 18:59:27 +08:00
guzekai01
21258b7a35
feat(humming): FP8 DeepEP dispatch for humming MoE backend ( #31429 )
2026-08-24 18:59:07 +08:00
Xiaoyu Zhang
46b92b22e2
[diffusion] Accelerate LingBot Video RMSNorm in quality=high ( #35969 )
2026-08-24 18:02:00 +08:00
092d85eb87
[Feature] Add MiniCPM-SALA support ( #30360 )
...
Co-authored-by: Alex Nails <alex.nails@radixark.ai >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-24 02:25:16 -07:00
SuperSong
d251fa2453
perf(unified-memory): batch lazy-compaction mapping lookup ( #34066 )
2026-08-24 02:14:45 -07:00
gaopengff and Ma Mingfei
317da0964e
[Intel XPU] support prefill only models for xpu ( #35072 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-08-24 16:25:47 +08:00
Alex Nails and Claude Opus 5
666b08b4a5
[ROCm] Extend the gfx950 extend-attention tile to head_dim <= 128: -43% kernel, -14% TTFT, bit-identical ( #34461 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-24 00:29:39 -07:00
ming_wang
97b176e64c
Support streaming session on NPU ( #32597 )
2026-08-24 14:07:44 +08:00
Xiaoyu Zhang
6d40b8aebf
[diffusion] Fix Hunyuan QKV pack indexing at production video shapes ( #36009 )
2026-08-24 13:39:26 +08:00
Yuan Luo and luoyuan.luo
77940dec80
[MoE] Gather the cutlass MoE activation and its scales in one launch ( #34915 )
...
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com >
2026-08-24 13:37:14 +08:00
Lianmin Zheng
b498efce52
chore: move cuda_vmm_utils.py under srt/utils/ ( #36053 )
2026-08-23 21:47:29 -07:00
gaopengff and Ma Mingfei
56834422a1
[Intel XPU] Add xpu pass for biased_topk and hash_topk ( #33323 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-08-24 12:18:22 +08:00
Chunyuan WU
1daa94a069
[CPU] Fix NUMA/core binding for DP ranks ( #32856 )
2026-08-24 12:15:38 +08:00
Aurick Qiao and Yuwei An
3e30649064
[Fix] Harden FlashAttention CUDA graph metadata bounds ( #35454 )
...
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com >
2026-08-23 21:11:46 -07:00
Xia Weiwen
5b5b29d4e2
[XPU] Use a fused GDN kernel from sgl-kernel for Qwen3.5 ( #33354 )
2026-08-24 12:07:50 +08:00
Xiaoyu Zhang
8dcfb3b5e7
[diffusion] Fuse LongCat-Image QKNorm and interleaved RoPE ( #35995 )
2026-08-24 12:07:26 +08:00
Mick
7a7b655ddf
[quantization] share bounded post-load device staging ( #35180 )
2026-08-24 11:48:30 +08:00
Alison Shao
0c1e9bda57
[OpenAI] Drop empty assistant turns for mistral_common tokenizers ( #35915 )
...
mistral_common rejects an assistant turn carrying neither content nor tool calls, while other chat templates ignore it, so an OpenAI-compatible request that works elsewhere failed on Mistral models. Drop those turns before templating; turns with tool_calls, multimodal content, or real text are untouched, and a trailing assistant message is already consumed upstream as the continue_final_message prefix.
2026-08-23 20:07:17 -07:00
Xun Sun and siyu
a90d770c40
[Weight Cache] Support static DP/EP layouts ( #33684 )
...
Co-authored-by: siyu <liusy58@linux.alibaba.com >
2026-08-23 19:57:52 -07:00
514b997e6c
Register CPU CI for 17 e2e tests and partition xeon base-c suite ( #35227 )
...
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com >
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-08-24 10:49:38 +08:00
YangKai0616 and gemini-code-assist[bot]
fbdec2855a
[XPU] Support INT4 dense linear (AWQ/GPTQ) for XPU ( #30236 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-08-24 10:41:59 +08:00
YanbingJiang
fd73d4b019
[CPU] Add graph register for fused_sigmoid_mul_cpu, fused_qk_gemma_rmsnorm ( #35506 )
2026-08-24 10:18:57 +08:00
Kalyan Kumar and vshekhawat-hlab
4c02584773
Add intel_xpu to DETERMINISTIC_ATTENTION_BACKEND_CHOICES ( #29143 )
...
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai >
2026-08-24 09:47:34 +08:00
Xiaoyu Zhang
e129fe21e5
[diffusion] Flatten Wan VAE RMSNorm row addressing ( #35981 )
2026-08-24 08:57:54 +08:00
Michael
20064623ab
[AMD][CI] Add the Qwen3.8 MXFP4 MI35x nightly ( #35383 )
2026-08-23 17:17:10 -07:00
Sahithi Chigurupati and Mohammad Miadh Angkad
44db041700
[NVIDIA] Fix SM107 MXFP8 activation prep ( #35405 )
...
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com >
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com >
2026-08-23 18:17:03 +08:00
27aa48bca1
[Fix] lfm2 detector: recover tool calls dropped by common model-outpu… ( #34237 )
...
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
2026-08-23 18:09:43 +08:00
Cheng Wan and Claude Opus 5
340391a297
config: publish before the launcher reads effective configuration ( #35910 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:20:20 -07:00
Cheng Wan and Claude Opus 5
a43592dce5
config: pin two orderings resolution relies on ( #35909 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:19:44 -07:00
Cheng Wan and Claude Opus 5
362c2ee849
config: borrowed-record reads follow the config bags ( #35908 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:19:20 -07:00
Cheng Wan and Claude Opus 5
64aa859da2
config: constructing a config no longer resolves it ( #35907 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:18:53 -07:00
Cheng Wan and Claude Opus 5
4bc79a1b49
config: project the config bags from the resolution result ( #35906 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:18:24 -07:00
Cheng Wan and Claude Opus 5
0e22777572
config: record resolution writes in a declaration stash ( #35905 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:17:27 -07:00
Cheng Wan
6218d6ce3f
config: a defensive publish must not re-project over a live process ( #35904 )
2026-08-23 01:16:39 -07:00