Commit Graph
6055 Commits
Author SHA1 Message Date
Alex NailsandClaude Opus 5 68575b23d0 [CI] Stop the config ratchets re-parsing the package on every scan (#36240)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 18:22:32 -07:00
pllimax d2d8ecea77 [npu] Combine NPU test fixes from #35472 and #34516 (#36180) 2026-08-25 09:00:40 +08:00
huangtingwei 0f7ba3d115 [HiSparse] Support hisparse multi-step swap io kernel (#32162) 2026-08-24 17:29:44 -07:00
Alex NailsandClaude Opus 5 1ec20fd25d [CI] Stop the resolution ratchets re-parsing the whole package (#36235)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 16:55:35 -07:00
effe0d14d2 [Fix] Keep the MiniCPM-SALA config reads visible to the resolution ratchets (#36178)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-24 16:05:09 -07:00
BingjiaWang 3c481b9421 [Benchmark] Add optional steady-state window for serving metrics (#30918) 2026-08-24 14:49:20 -07:00
AMD-yanfeiwang 24bce93c93 [AMD][MORI] Deduplicate CP-replicated state transfers (#36025) 2026-08-24 14:43:52 -07:00
jacky.cheng 0665740953 [AMD][Fix] Route MoRI through the Qwen MoE all-to-all path (#32039) 2026-08-24 13:04:08 -07:00
Ke Bao 586211bc46 Add PD test for inkling with mxfp8 KV (#35840) 2026-08-25 00:12:05 +08:00
Ke Bao 54ec2c4699 Fix recurrent state loss on decode retraction (#35957) 2026-08-25 00:11:05 +08:00
fzyzcjy e586a6f2c5 Report the whole server's world size in the scheduler's internal state (#35929) 2026-08-24 20:21:45 +08:00
fzyzcjy 6dd79576cd Expose the declared sglang env vars of a scheduler in its internal state (#35928) 2026-08-24 20:20:29 +08:00
fzyzcjy c56cee0f80 Support gated launch to defer startup memory allocation (#35927) 2026-08-24 20:19:45 +08:00
fzyzcjy 3b24d8981b Report per-token weight-version spans in generation meta info (#35926) 2026-08-24 20:18:52 +08:00
fzyzcjy 981dfa2b83 Make the scheduler track the published weight version (#35925) 2026-08-24 20:17:50 +08:00
Hert4andAlex Nails b4bd5f91ee [diffusion] Fix test_model_fast_paths import after sana_ln_modulate rename (#36175)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-24 04:48:17 -07:00
guzekai01 716a6bf10c feat(humming): support native W4AFP8 checkpoint schemas (#32033) 2026-08-24 18:59:27 +08:00
guzekai01 21258b7a35 feat(humming): FP8 DeepEP dispatch for humming MoE backend (#31429) 2026-08-24 18:59:07 +08:00
Xiaoyu Zhang 46b92b22e2 [diffusion] Accelerate LingBot Video RMSNorm in quality=high (#35969) 2026-08-24 18:02:00 +08:00
092d85eb87 [Feature] Add MiniCPM-SALA support (#30360)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 02:25:16 -07:00
SuperSong d251fa2453 perf(unified-memory): batch lazy-compaction mapping lookup (#34066) 2026-08-24 02:14:45 -07:00
gaopengffandMa Mingfei 317da0964e [Intel XPU] support prefill only models for xpu (#35072)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-24 16:25:47 +08:00
Alex NailsandClaude Opus 5 666b08b4a5 [ROCm] Extend the gfx950 extend-attention tile to head_dim <= 128: -43% kernel, -14% TTFT, bit-identical (#34461)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 00:29:39 -07:00
ming_wang 97b176e64c Support streaming session on NPU (#32597) 2026-08-24 14:07:44 +08:00
Xiaoyu Zhang 6d40b8aebf [diffusion] Fix Hunyuan QKV pack indexing at production video shapes (#36009) 2026-08-24 13:39:26 +08:00
Yuan Luoandluoyuan.luo 77940dec80 [MoE] Gather the cutlass MoE activation and its scales in one launch (#34915)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-08-24 13:37:14 +08:00
Lianmin Zheng b498efce52 chore: move cuda_vmm_utils.py under srt/utils/ (#36053) 2026-08-23 21:47:29 -07:00
gaopengffandMa Mingfei 56834422a1 [Intel XPU] Add xpu pass for biased_topk and hash_topk (#33323)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-24 12:18:22 +08:00
Chunyuan WU 1daa94a069 [CPU] Fix NUMA/core binding for DP ranks (#32856) 2026-08-24 12:15:38 +08:00
Aurick QiaoandYuwei An 3e30649064 [Fix] Harden FlashAttention CUDA graph metadata bounds (#35454)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
2026-08-23 21:11:46 -07:00
Xia Weiwen 5b5b29d4e2 [XPU] Use a fused GDN kernel from sgl-kernel for Qwen3.5 (#33354) 2026-08-24 12:07:50 +08:00
Xiaoyu Zhang 8dcfb3b5e7 [diffusion] Fuse LongCat-Image QKNorm and interleaved RoPE (#35995) 2026-08-24 12:07:26 +08:00
Mick 7a7b655ddf [quantization] share bounded post-load device staging (#35180) 2026-08-24 11:48:30 +08:00
Alison Shao 0c1e9bda57 [OpenAI] Drop empty assistant turns for mistral_common tokenizers (#35915)
mistral_common rejects an assistant turn carrying neither content nor tool calls, while other chat templates ignore it, so an OpenAI-compatible request that works elsewhere failed on Mistral models. Drop those turns before templating; turns with tool_calls, multimodal content, or real text are untouched, and a trailing assistant message is already consumed upstream as the continue_final_message prefix.
2026-08-23 20:07:17 -07:00
Xun Sunandsiyu a90d770c40 [Weight Cache] Support static DP/EP layouts (#33684)
Co-authored-by: siyu <liusy58@linux.alibaba.com>
2026-08-23 19:57:52 -07:00
514b997e6c Register CPU CI for 17 e2e tests and partition xeon base-c suite (#35227)
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-24 10:49:38 +08:00
YangKai0616andgemini-code-assist[bot] fbdec2855a [XPU] Support INT4 dense linear (AWQ/GPTQ) for XPU (#30236)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-08-24 10:41:59 +08:00
YanbingJiang fd73d4b019 [CPU] Add graph register for fused_sigmoid_mul_cpu, fused_qk_gemma_rmsnorm (#35506) 2026-08-24 10:18:57 +08:00
Kalyan Kumarandvshekhawat-hlab 4c02584773 Add intel_xpu to DETERMINISTIC_ATTENTION_BACKEND_CHOICES (#29143)
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai>
2026-08-24 09:47:34 +08:00
Xiaoyu Zhang e129fe21e5 [diffusion] Flatten Wan VAE RMSNorm row addressing (#35981) 2026-08-24 08:57:54 +08:00
Michael 20064623ab [AMD][CI] Add the Qwen3.8 MXFP4 MI35x nightly (#35383) 2026-08-23 17:17:10 -07:00
Sahithi ChigurupatiandMohammad Miadh Angkad 44db041700 [NVIDIA] Fix SM107 MXFP8 activation prep (#35405)
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-08-23 18:17:03 +08:00
27aa48bca1 [Fix] lfm2 detector: recover tool calls dropped by common model-outpu… (#34237)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-08-23 18:09:43 +08:00
Cheng WanandClaude Opus 5 340391a297 config: publish before the launcher reads effective configuration (#35910)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-23 01:20:20 -07:00
Cheng WanandClaude Opus 5 a43592dce5 config: pin two orderings resolution relies on (#35909)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-23 01:19:44 -07:00
Cheng WanandClaude Opus 5 362c2ee849 config: borrowed-record reads follow the config bags (#35908)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-23 01:19:20 -07:00
Cheng WanandClaude Opus 5 64aa859da2 config: constructing a config no longer resolves it (#35907)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-23 01:18:53 -07:00
Cheng WanandClaude Opus 5 4bc79a1b49 config: project the config bags from the resolution result (#35906)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-23 01:18:24 -07:00
Cheng WanandClaude Opus 5 0e22777572 config: record resolution writes in a declaration stash (#35905)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-23 01:17:27 -07:00
Cheng Wan 6218d6ce3f config: a defensive publish must not re-project over a live process (#35904) 2026-08-23 01:16:39 -07:00