Commit Graph
12235 Commits
Author SHA1 Message Date
Khoa PhamandClaude Opus 4.7 c2d60c3667 chore(codeowners): add @kpham-sgl as codeowner for ngram files (#24349)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-03 23:27:33 -07:00
Liangsheng Yin a91ae6af9e nextn subclass owns post_load_weights is_nextn (#24333) 2026-05-03 22:04:44 -07:00
Liangsheng Yin 1dd8f6d5ae dedup state_kv_args setup into helper (#24340) 2026-05-03 20:45:26 -07:00
Liangsheng Yin 91fa2340ed extract adjust_hybrid_swa_layers_for_pp (#24334) 2026-05-03 18:52:54 -07:00
Ethan (Yusheng) Su b7fefc0e85 feat(lora): enable csgmv backend with virtual experts for MoE LoRA (#24007) 2026-05-03 18:44:17 -07:00
Mick c611a3fb78 [diffusion] chore: disable VAE cpu offload by default (#24315) 2026-05-04 08:24:51 +08:00
Liangsheng Yin 00d620b77d introduce arg_groups/ with nemotron_h hook (#24328) 2026-05-03 16:28:11 -07:00
Liangsheng Yin c3b6d20a80 Register deepseek_v32 alias instead of rewriting config.json (#24295) 2026-05-03 16:02:17 -07:00
Liangsheng Yin 53df43d0a3 rerun-test: route deepep h200 suite to deepep runner (#24325) 2026-05-03 15:57:53 -07:00
ZhanghengandShangming Cai 9a5450ad73 [PD]: Support incremental transfer for mooncake transfer engine (#24257)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-05-04 00:57:59 +08:00
Chi McIsaacandJunhao Liu 62265ca7fc [diffusion] feat: initial support for dynamic batching (#18764)
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Junhao Liu <junhaoliu2023@gmail.com>
2026-05-04 00:44:42 +08:00
Xiaoyu ZhangandMick f2d1390909 [Diffusion] Add Qwen Image ModelOpt FP8 support (#23155)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-05-04 00:24:22 +08:00
Mick 5925572c95 [diffusion] CI: switch CI data references to sgl-project/ci-data (#24299) 2026-05-03 23:05:12 +08:00
c0f5950636 [UnifiedRadixTree]: Support HiCache Framework for UnifiedRadixTree (#23316)
Co-authored-by: JINZ <1023553676@qq.com>
Co-authored-by: diemchai <diemchai@tencent.com>
2026-05-03 22:13:22 +08:00
GXINandronnie_zheng e37f46fcf7 [NPU] Fix Z-Image negative-branch rotary embeddings for CFG (#23538)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-03 16:18:26 +03:00
ZhanghengandShangming Cai 44ca2d01fc [pd]: (Bug Fix) Incorrect out_cache_loc slicing in prepare_for_prebuilt (#24230)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-05-03 18:35:16 +08:00
Mick 2bfc5d3bb1 [diffusion] optimize LTX2.3 HQ denoising split passes (#24298) 2026-05-03 16:37:46 +08:00
Mick 8b12367b92 [diffusion] CI: add diffusion GT generation (official implementation) to the workflow (#24270) 2026-05-03 15:10:35 +08:00
Liangsheng YinandDarkSharpness fcc8b7b126 Rename SGLANG_USE_JIT_ALL_REDUCE to SGLANG_OPT_USE_CUSTOM_ALL_REDUCE_V2 (#24297)
Co-authored-by: DarkSharpness <2040703891@qq.com>
2026-05-02 23:59:46 -07:00
Mohammad Miadh Angkad b7d8ceb444 [CI] Keep custom sgl-kernel wheel in CUDA CI (#24291) 2026-05-02 21:53:21 -07:00
Kangyan-ZhouandClaude Opus 4.7 266d994368 [CI] Fix nightly NV jobs cancelling each other via shared concurrency groups (#24282)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-02 21:53:03 -07:00
Glen Liu 76b9c8de6f [Feature] add LoRADrainer to address high P99 TTFT (#17913) 2026-05-02 16:13:43 -07:00
Baizhou Zhang 200944b415 Update kernel installation instructions after shifting default cuda to 13 (#24181) 2026-05-02 16:07:20 -07:00
88bb5dffe4 [Dependency] Upgrade to Torch 2.11.0 (#21247)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-05-02 12:25:36 -07:00
24a6b3084d [CI] drop --prerelease allow from uv pip install suffix (#24265)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-02 12:25:01 -07:00
Kangyan-ZhouandClaude Opus 4.7 d74d9bda49 [gateway] Align /v1/loads and /model_info with sglang server; drop dead /rerank (#24167)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-02 11:43:30 -07:00
Glen LiuandEthan Su e0474fdd9b throw ValueError for DoRA adapters (#22125)
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
2026-05-02 14:54:19 +00:00
Xiaoyu Zhang 4128f1ffe2 [SKILLS] Tiny upgrade diffusion skills (#24273) 2026-05-02 22:04:05 +08:00
Xiaoyu Zhang b712dd48fe [codex] diffusion: enable group norm silu fuse by default (#23148) 2026-05-02 20:55:51 +08:00
Xiaoyu Zhang 1360848ee1 Optimize large GroupNorm SiLU apply (#23938) 2026-05-02 20:54:46 +08:00
egvenediktovandronnie_zheng 83bf5d6869 [NPU]TP Communications compression For Qwen3 models for NPU (#20520)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-02 14:29:11 +03:00
ebbaab5597 [NPU] Add GitHub test summary and deduplicate test code. Part 1 (#23835)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-02 14:18:18 +03:00
3259a2c789 Encode routed_experts in the detokenizer, off the tokenizer hot path (#24263)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Yueming Yuan <yym022502@gmail.com>
2026-05-02 02:44:32 -07:00
Xiaoyu Zhang 589f90b368 [diffusion] chore: use lmsys as org for modelopt checkpoints (#23924) 2026-05-02 17:18:58 +08:00
Alison Shao f3dbadb82b fix: accept 0-indexed safetensors shard names in CI weight validator (#24237) 2026-05-02 00:58:15 -07:00
Kangyan-ZhouandClaude Opus 4.7 2e72a36420 [CI] Restore SMG e2e on 2-gpu-h100 / 4-gpu-h100 runners (#24222)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 23:55:20 -07:00
billishyahao b939d5410f [AMD] enable sdma for moriep unittest (#24259) 2026-05-01 23:34:53 -07:00
Clayandchengyusong1 5ec3b26799 [diffusion] model: support JoyAI-Image-Edit (#22625)
Co-authored-by: chengyusong1 <chengyusong1@jd.com>
2026-05-02 14:08:57 +08:00
Kangyan-ZhouandClaude Opus 4.7 cd27baaffd [ci][cu13] Bump torch_memory_saver to 0.0.9.post1; restore manual tests (#23182)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 22:50:38 -07:00
Kangyan-ZhouandClaude Opus 4.7 674a80d5d8 [CI] Add 1-gpu-h100-h200 to rerun-test runner_label choices (#24264)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 22:45:48 -07:00
Mick b7d4647568 [diffusion] CI: change ground truth repo (#24219) 2026-05-01 21:25:40 -07:00
Sam Shleifer 63f225ca2e [session] fix mamba pool leak in StreamingSession.release_session + plumb idle leak check (#23496) 2026-05-02 11:38:08 +08:00
d41e8c459d Support RunAI loading for quantized checkpoints (#23850)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Sam Shleifer <sam@thinkingmachines.ai>
2026-05-02 11:11:40 +08:00
Xiaoyu Zhang 321298da75 [SKILL] Upgrade sglang profile and auto_benchmark skills (#24250) 2026-05-02 10:12:47 +08:00
Johnsonms 4c2ed9a254 Flux2 nvfp4 quantization correctness on Blackwell (B200) (#23625) 2026-05-02 09:57:35 +08:00
Aurick Qiao bfccc8e504 Allow configuring NIXL backend parameters from env (#24169) 2026-05-01 18:30:43 -07:00
Mick 193b977572 [diffusion] chore: clean scheduler (#24229) 2026-05-02 09:30:06 +08:00
Liangsheng Yin cb8fbd53fc Reserve slot 0 as padding in all req pools (#24243) 2026-05-01 16:41:36 -07:00
Cheng Wan b47fab6f5d [bugfix] Support MIXED forward mode in TBO splitter for DP attention (#24241) 2026-05-01 16:01:23 -07:00
Lucia Fang 05de73efd1 [core/model] Use explicit model arch for Llama4 attention backend auto-selection (#24232) 2026-05-01 15:49:30 -07:00