Commit Graph
18705 Commits
Author SHA1 Message Date
Alex NailsandClaude Opus 5 5ffdb02d0c [CI] Cut repeated tokenizer loads, serial subprocesses and a double scan (#36241)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 18:22:43 -07:00
Alex NailsandClaude Opus 5 68575b23d0 [CI] Stop the config ratchets re-parsing the package on every scan (#36240)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 18:22:32 -07:00
Mick f8f9226cd2 [diffusion] feat: support component-scoped quantization overrides (#36035) 2026-08-25 09:20:47 +08:00
Mick ddea7b9156 [diffusion] feat: support mixed Comfy NVFP4 and INT8 layers (#36061) 2026-08-25 09:19:47 +08:00
pllimax d2d8ecea77 [npu] Combine NPU test fixes from #35472 and #34516 (#36180) 2026-08-25 09:00:40 +08:00
eeecho 91e7e84ee5 [SM120] flash_mla: allocate the page-split buffer outside inference mode (#35116) 2026-08-24 17:42:23 -07:00
huangtingwei 0f7ba3d115 [HiSparse] Support hisparse multi-step swap io kernel (#32162) 2026-08-24 17:29:44 -07:00
Alex NailsandClaude Opus 5 1ec20fd25d [CI] Stop the resolution ratchets re-parsing the whole package (#36235)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 16:55:35 -07:00
effe0d14d2 [Fix] Keep the MiniCPM-SALA config reads visible to the resolution ratchets (#36178)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-24 16:05:09 -07:00
BingjiaWang 3c481b9421 [Benchmark] Add optional steady-state window for serving metrics (#30918) 2026-08-24 14:49:20 -07:00
AMD-yanfeiwang 24bce93c93 [AMD][MORI] Deduplicate CP-replicated state transfers (#36025) 2026-08-24 14:43:52 -07:00
jacky.cheng 0d5b5ae620 [AMD] Fix Qwen3.5 MTP dropping fused shared-expert weights (#35719) 2026-08-24 13:18:42 -07:00
jacky.cheng 0665740953 [AMD][Fix] Route MoRI through the Qwen MoE all-to-all path (#32039) 2026-08-24 13:04:08 -07:00
Xinyuan Tong 6e2f87d589 docs: mark Ling-3.0-flash DSPARK verified for all four quantizations on H200 (#36204) 2026-08-25 02:05:32 +08:00
Jimmy Shong 5030637c65 [docs] Split the Qwen3.8-27B NVFP4 cells by lm_head precision (#36020) 2026-08-25 01:50:33 +08:00
Ke Bao d10a656ad8 Cleanup duplicate mamba backup helper (#36203) 2026-08-25 00:52:37 +08:00
Ke Bao 586211bc46 Add PD test for inkling with mxfp8 KV (#35840) 2026-08-25 00:12:05 +08:00
Ke Bao 54ec2c4699 Fix recurrent state loss on decode retraction (#35957) 2026-08-25 00:11:05 +08:00
Mick 30f9ed09d1 [diffusion] feat: support loading minimax h3 gguf text encoders (#36055) 2026-08-24 23:00:49 +08:00
Mick 9b0007ed19 [diffusion] feat: support loading comfy nvfp4 minimax h3 checkpoints (#36044) 2026-08-24 22:57:02 +08:00
Mick 76d1401881 [diffusion] feat: support mixed w4a4 and int8 checkpoints (#36040) 2026-08-24 20:35:11 +08:00
fzyzcjy e586a6f2c5 Report the whole server's world size in the scheduler's internal state (#35929) 2026-08-24 20:21:45 +08:00
fzyzcjy 6dd79576cd Expose the declared sglang env vars of a scheduler in its internal state (#35928) 2026-08-24 20:20:29 +08:00
fzyzcjy c56cee0f80 Support gated launch to defer startup memory allocation (#35927) 2026-08-24 20:19:45 +08:00
fzyzcjy 3b24d8981b Report per-token weight-version spans in generation meta info (#35926) 2026-08-24 20:18:52 +08:00
fzyzcjy 981dfa2b83 Make the scheduler track the published weight version (#35925) 2026-08-24 20:17:50 +08:00
fzyzcjy 02a3dca738 Extract _make_abort_req from the scheduler's abort paths (#35924) 2026-08-24 20:16:38 +08:00
fzyzcjy a37fdae562 Extract collect_inflight_reqs from abort_request for reusing (#35923) 2026-08-24 20:15:09 +08:00
Mick 9856b58de4 [diffusion] feat: support loading serialized fp8 clip image encoders (#36056) 2026-08-24 19:59:35 +08:00
Hert4andAlex Nails b4bd5f91ee [diffusion] Fix test_model_fast_paths import after sana_ln_modulate rename (#36175)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-24 04:48:17 -07:00
Mick bfeae4e79a [diffusion] feat: support loading serialized convrot w4a4 checkpoints (#36039) 2026-08-24 19:13:35 +08:00
guzekai01 716a6bf10c feat(humming): support native W4AFP8 checkpoint schemas (#32033) 2026-08-24 18:59:27 +08:00
guzekai01 21258b7a35 feat(humming): FP8 DeepEP dispatch for humming MoE backend (#31429) 2026-08-24 18:59:07 +08:00
Xiaoyu Zhang 46b92b22e2 [diffusion] Accelerate LingBot Video RMSNorm in quality=high (#35969) 2026-08-24 18:02:00 +08:00
Bingxu Chen d8433868ce [AMD][CI] Temporarily bypass local-registry image pulls (#36171) 2026-08-24 17:44:53 +08:00
092d85eb87 [Feature] Add MiniCPM-SALA support (#30360)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 02:25:16 -07:00
SuperSong d251fa2453 perf(unified-memory): batch lazy-compaction mapping lookup (#34066) 2026-08-24 02:14:45 -07:00
Mick 51b27f747a [diffusion] feat: support loading pruned minimax h3 components natively (#36070) 2026-08-24 16:39:37 +08:00
Mick adc09a1f63 [diffusion] feat: support loading self-describing quanto int8 encoders (#36052) 2026-08-24 16:37:09 +08:00
Mick 5081ad5d4e [diffusion] feat: add per-component quantization overrides (#36084) 2026-08-24 16:35:48 +08:00
gaopengffandMa Mingfei 317da0964e [Intel XPU] support prefill only models for xpu (#35072)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-24 16:25:47 +08:00
Bingxu ChenandCursor 7de80e566c [AMD][CI] Name the ROCm Image That Actually Ran in AMD Job Names (#35686)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-24 01:07:25 -07:00
jiayisunx 5c4622341f [GDN] remove XPU path of causal_conv1d_fn and causal_conv1d_update (#35775) 2026-08-24 15:59:23 +08:00
Alex NailsandClaude Opus 5 2070927e00 [Triton] Bound the sliding-window extend-attention KV loop: -86.6% on SWA layers, -9.4% prefill GPU, bit-identical (#34462)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 00:58:52 -07:00
7bbd0ddeb5 [AMD] Quark shared-experts gate: recognise a trailing MTP layer (#36124)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-08-24 00:53:52 -07:00
Shangming Cai f464e77d17 fix(mini-lb): forward the flush_cache timeout param to workers (#36150) 2026-08-24 15:32:57 +08:00
Alex NailsandClaude Opus 5 666b08b4a5 [ROCm] Extend the gfx950 extend-attention tile to head_dim <= 128: -43% kernel, -14% TTFT, bit-identical (#34461)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 00:29:39 -07:00
McZyWu c439e77872 [bugfix] [NPU] fix transpose batch matmul K*B exceed 65536. (#34715) 2026-08-24 15:22:59 +08:00
pllimax e28b9cf7b0 Npu single node test timeout config (#36092) 2026-08-24 14:38:02 +08:00
MickandClaude Fable 5 c8e1ddc707 [diffusion] feat: cache LoRA-merged weights in files the page cache can hold (#36062)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-24 14:18:55 +08:00