|
effe0d14d2
|
[Fix] Keep the MiniCPM-SALA config reads visible to the resolution ratchets (#36178)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-24 16:05:09 -07:00 |
|
|
BingjiaWang
|
3c481b9421
|
[Benchmark] Add optional steady-state window for serving metrics (#30918)
|
2026-08-24 14:49:20 -07:00 |
|
|
AMD-yanfeiwang
|
24bce93c93
|
[AMD][MORI] Deduplicate CP-replicated state transfers (#36025)
|
2026-08-24 14:43:52 -07:00 |
|
|
jacky.cheng
|
0d5b5ae620
|
[AMD] Fix Qwen3.5 MTP dropping fused shared-expert weights (#35719)
|
2026-08-24 13:18:42 -07:00 |
|
|
jacky.cheng
|
0665740953
|
[AMD][Fix] Route MoRI through the Qwen MoE all-to-all path (#32039)
|
2026-08-24 13:04:08 -07:00 |
|
|
Ke Bao
|
d10a656ad8
|
Cleanup duplicate mamba backup helper (#36203)
|
2026-08-25 00:52:37 +08:00 |
|
|
Ke Bao
|
586211bc46
|
Add PD test for inkling with mxfp8 KV (#35840)
|
2026-08-25 00:12:05 +08:00 |
|
|
Ke Bao
|
54ec2c4699
|
Fix recurrent state loss on decode retraction (#35957)
|
2026-08-25 00:11:05 +08:00 |
|
|
Mick
|
30f9ed09d1
|
[diffusion] feat: support loading minimax h3 gguf text encoders (#36055)
|
2026-08-24 23:00:49 +08:00 |
|
|
Mick
|
9b0007ed19
|
[diffusion] feat: support loading comfy nvfp4 minimax h3 checkpoints (#36044)
|
2026-08-24 22:57:02 +08:00 |
|
|
Mick
|
76d1401881
|
[diffusion] feat: support mixed w4a4 and int8 checkpoints (#36040)
|
2026-08-24 20:35:11 +08:00 |
|
|
fzyzcjy
|
e586a6f2c5
|
Report the whole server's world size in the scheduler's internal state (#35929)
|
2026-08-24 20:21:45 +08:00 |
|
|
fzyzcjy
|
6dd79576cd
|
Expose the declared sglang env vars of a scheduler in its internal state (#35928)
|
2026-08-24 20:20:29 +08:00 |
|
|
fzyzcjy
|
c56cee0f80
|
Support gated launch to defer startup memory allocation (#35927)
|
2026-08-24 20:19:45 +08:00 |
|
|
fzyzcjy
|
3b24d8981b
|
Report per-token weight-version spans in generation meta info (#35926)
|
2026-08-24 20:18:52 +08:00 |
|
|
fzyzcjy
|
981dfa2b83
|
Make the scheduler track the published weight version (#35925)
|
2026-08-24 20:17:50 +08:00 |
|
|
fzyzcjy
|
02a3dca738
|
Extract _make_abort_req from the scheduler's abort paths (#35924)
|
2026-08-24 20:16:38 +08:00 |
|
|
fzyzcjy
|
a37fdae562
|
Extract collect_inflight_reqs from abort_request for reusing (#35923)
|
2026-08-24 20:15:09 +08:00 |
|
|
Mick
|
9856b58de4
|
[diffusion] feat: support loading serialized fp8 clip image encoders (#36056)
|
2026-08-24 19:59:35 +08:00 |
|
|
Mick
|
bfeae4e79a
|
[diffusion] feat: support loading serialized convrot w4a4 checkpoints (#36039)
|
2026-08-24 19:13:35 +08:00 |
|
|
guzekai01
|
716a6bf10c
|
feat(humming): support native W4AFP8 checkpoint schemas (#32033)
|
2026-08-24 18:59:27 +08:00 |
|
|
guzekai01
|
21258b7a35
|
feat(humming): FP8 DeepEP dispatch for humming MoE backend (#31429)
|
2026-08-24 18:59:07 +08:00 |
|
|
Xiaoyu Zhang
|
46b92b22e2
|
[diffusion] Accelerate LingBot Video RMSNorm in quality=high (#35969)
|
2026-08-24 18:02:00 +08:00 |
|
|
|
092d85eb87
|
[Feature] Add MiniCPM-SALA support (#30360)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-24 02:25:16 -07:00 |
|
|
SuperSong
|
d251fa2453
|
perf(unified-memory): batch lazy-compaction mapping lookup (#34066)
|
2026-08-24 02:14:45 -07:00 |
|
|
Mick
|
51b27f747a
|
[diffusion] feat: support loading pruned minimax h3 components natively (#36070)
|
2026-08-24 16:39:37 +08:00 |
|
|
Mick
|
adc09a1f63
|
[diffusion] feat: support loading self-describing quanto int8 encoders (#36052)
|
2026-08-24 16:37:09 +08:00 |
|
|
Mick
|
5081ad5d4e
|
[diffusion] feat: add per-component quantization overrides (#36084)
|
2026-08-24 16:35:48 +08:00 |
|
|
jiayisunx
|
5c4622341f
|
[GDN] remove XPU path of causal_conv1d_fn and causal_conv1d_update (#35775)
|
2026-08-24 15:59:23 +08:00 |
|
|
Alex NailsandClaude Opus 5
|
2070927e00
|
[Triton] Bound the sliding-window extend-attention KV loop: -86.6% on SWA layers, -9.4% prefill GPU, bit-identical (#34462)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-24 00:58:52 -07:00 |
|
|
|
7bbd0ddeb5
|
[AMD] Quark shared-experts gate: recognise a trailing MTP layer (#36124)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-08-24 00:53:52 -07:00 |
|
|
Alex NailsandClaude Opus 5
|
666b08b4a5
|
[ROCm] Extend the gfx950 extend-attention tile to head_dim <= 128: -43% kernel, -14% TTFT, bit-identical (#34461)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-24 00:29:39 -07:00 |
|
|
McZyWu
|
c439e77872
|
[bugfix] [NPU] fix transpose batch matmul K*B exceed 65536. (#34715)
|
2026-08-24 15:22:59 +08:00 |
|
|
MickandClaude Fable 5
|
c8e1ddc707
|
[diffusion] feat: cache LoRA-merged weights in files the page cache can hold (#36062)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-24 14:18:55 +08:00 |
|
|
Xiaoyu Zhang
|
9866fe910b
|
[diffusion] Speed up LingBot high-quality VAE decode (#36024)
|
2026-08-24 14:13:03 +08:00 |
|
|
Xiaoyu Zhang
|
cc74aba330
|
[diffusion] Honor XDG cache for model overlays (#36019)
|
2026-08-24 14:11:26 +08:00 |
|
|
ming_wang
|
97b176e64c
|
Support streaming session on NPU (#32597)
|
2026-08-24 14:07:44 +08:00 |
|
|
Shangming Cai
|
852b04b358
|
fix(xpu): read enable_deterministic_inference from the config bag (#36149)
|
2026-08-24 13:56:41 +08:00 |
|
|
Xiaoyu Zhang
|
6d40b8aebf
|
[diffusion] Fix Hunyuan QKV pack indexing at production video shapes (#36009)
|
2026-08-24 13:39:26 +08:00 |
|
|
Xiaoyu Zhang
|
b43931e878
|
[diffusion] Refresh quality and BCG benchmark skills (#36016)
Signed-off-by: BBuf <1182563586@qq.com>
|
2026-08-24 13:37:45 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
77940dec80
|
[MoE] Gather the cutlass MoE activation and its scales in one launch (#34915)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-08-24 13:37:14 +08:00 |
|
|
Mick
|
3fe18f13cd
|
[diffusion] feat: add plain component weight overrides (#36086)
|
2026-08-24 13:33:23 +08:00 |
|
|
Mick
|
8df3b9eff9
|
[diffusion] feat: support loading mixed w4a8 text encoders (#36037)
|
2026-08-24 13:31:27 +08:00 |
|
|
Xiaoyu Zhang
|
344613c159
|
[diffusion] Default Hunyuan VAE to tiled decode (#36012)
|
2026-08-24 13:18:06 +08:00 |
|
|
vikram singh shekhawat
|
f98b60de80
|
fix(xpu): enable compressed-tensors FP8 W8A8 on XPU (RedHatAI FP8-dynamic models) (#33057)
|
2026-08-24 12:53:48 +08:00 |
|
|
Lianmin Zheng
|
b498efce52
|
chore: move cuda_vmm_utils.py under srt/utils/ (#36053)
|
2026-08-23 21:47:29 -07:00 |
|
|
gaopengffandMa Mingfei
|
56834422a1
|
[Intel XPU] Add xpu pass for biased_topk and hash_topk (#33323)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-08-24 12:18:22 +08:00 |
|
|
Chunyuan WU
|
1daa94a069
|
[CPU] Fix NUMA/core binding for DP ranks (#32856)
|
2026-08-24 12:15:38 +08:00 |
|
|
Aurick QiaoandYuwei An
|
3e30649064
|
[Fix] Harden FlashAttention CUDA graph metadata bounds (#35454)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-08-23 21:11:46 -07:00 |
|
|
Xia Weiwen
|
5b5b29d4e2
|
[XPU] Use a fused GDN kernel from sgl-kernel for Qwen3.5 (#33354)
|
2026-08-24 12:07:50 +08:00 |
|