|
952b3caf18
|
feat: use structural tags to enable strict tool calling and reasoning for more models (#21722)
Signed-off-by: Yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-05-04 02:30:28 -07:00 |
|
|
Khoa Pham
|
ef2b1b6d89
|
Fix flashinfer workspace OOM (#24172)
|
2026-05-04 01:26:35 -07:00 |
|
|
Baizhou ZhangandClaude Opus 4.7
|
de08c804c5
|
Add release workflow for sgl-deep-gemm wheels (#24348)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-04 00:58:44 -07:00 |
|
|
|
52b4609789
|
[Docker] Prep for torch 2.11: cu129 fix, image validator, dep cleanup (#23593)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-05-04 00:37:55 -07:00 |
|
|
Bingxu ChenandYC Yen-Ching Tseng
|
5eff3c489a
|
[AMD] Deepseek v4 Flash / Pro nightly tests for MI35x ROCm 7.2 (#24203)
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
|
2026-05-04 00:02:33 -07:00 |
|
|
Ke Bao
|
aea527afdc
|
Fix swa chunk req deferred (#24318)
|
2026-05-04 14:52:15 +08:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
c2d60c3667
|
chore(codeowners): add @kpham-sgl as codeowner for ngram files (#24349)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-03 23:27:33 -07:00 |
|
|
Liangsheng Yin
|
a91ae6af9e
|
nextn subclass owns post_load_weights is_nextn (#24333)
|
2026-05-03 22:04:44 -07:00 |
|
|
Liangsheng Yin
|
1dd8f6d5ae
|
dedup state_kv_args setup into helper (#24340)
|
2026-05-03 20:45:26 -07:00 |
|
|
Liangsheng Yin
|
91fa2340ed
|
extract adjust_hybrid_swa_layers_for_pp (#24334)
|
2026-05-03 18:52:54 -07:00 |
|
|
Ethan (Yusheng) Su
|
b7fefc0e85
|
feat(lora): enable csgmv backend with virtual experts for MoE LoRA (#24007)
|
2026-05-03 18:44:17 -07:00 |
|
|
Mick
|
c611a3fb78
|
[diffusion] chore: disable VAE cpu offload by default (#24315)
|
2026-05-04 08:24:51 +08:00 |
|
|
Liangsheng Yin
|
00d620b77d
|
introduce arg_groups/ with nemotron_h hook (#24328)
|
2026-05-03 16:28:11 -07:00 |
|
|
Liangsheng Yin
|
c3b6d20a80
|
Register deepseek_v32 alias instead of rewriting config.json (#24295)
|
2026-05-03 16:02:17 -07:00 |
|
|
Liangsheng Yin
|
53df43d0a3
|
rerun-test: route deepep h200 suite to deepep runner (#24325)
|
2026-05-03 15:57:53 -07:00 |
|
|
ZhanghengandShangming Cai
|
9a5450ad73
|
[PD]: Support incremental transfer for mooncake transfer engine (#24257)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-04 00:57:59 +08:00 |
|
|
Chi McIsaacandJunhao Liu
|
62265ca7fc
|
[diffusion] feat: initial support for dynamic batching (#18764)
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Junhao Liu <junhaoliu2023@gmail.com>
|
2026-05-04 00:44:42 +08:00 |
|
|
Xiaoyu ZhangandMick
|
f2d1390909
|
[Diffusion] Add Qwen Image ModelOpt FP8 support (#23155)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-05-04 00:24:22 +08:00 |
|
|
Mick
|
5925572c95
|
[diffusion] CI: switch CI data references to sgl-project/ci-data (#24299)
|
2026-05-03 23:05:12 +08:00 |
|
|
|
c0f5950636
|
[UnifiedRadixTree]: Support HiCache Framework for UnifiedRadixTree (#23316)
Co-authored-by: JINZ <1023553676@qq.com>
Co-authored-by: diemchai <diemchai@tencent.com>
|
2026-05-03 22:13:22 +08:00 |
|
|
GXINandronnie_zheng
|
e37f46fcf7
|
[NPU] Fix Z-Image negative-branch rotary embeddings for CFG (#23538)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-03 16:18:26 +03:00 |
|
|
ZhanghengandShangming Cai
|
44ca2d01fc
|
[pd]: (Bug Fix) Incorrect out_cache_loc slicing in prepare_for_prebuilt (#24230)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-03 18:35:16 +08:00 |
|
|
Mick
|
2bfc5d3bb1
|
[diffusion] optimize LTX2.3 HQ denoising split passes (#24298)
|
2026-05-03 16:37:46 +08:00 |
|
|
Mick
|
8b12367b92
|
[diffusion] CI: add diffusion GT generation (official implementation) to the workflow (#24270)
|
2026-05-03 15:10:35 +08:00 |
|
|
Liangsheng YinandDarkSharpness
|
fcc8b7b126
|
Rename SGLANG_USE_JIT_ALL_REDUCE to SGLANG_OPT_USE_CUSTOM_ALL_REDUCE_V2 (#24297)
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-05-02 23:59:46 -07:00 |
|
|
Mohammad Miadh Angkad
|
b7d8ceb444
|
[CI] Keep custom sgl-kernel wheel in CUDA CI (#24291)
|
2026-05-02 21:53:21 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
266d994368
|
[CI] Fix nightly NV jobs cancelling each other via shared concurrency groups (#24282)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-02 21:53:03 -07:00 |
|
|
Glen Liu
|
76b9c8de6f
|
[Feature] add LoRADrainer to address high P99 TTFT (#17913)
|
2026-05-02 16:13:43 -07:00 |
|
|
Baizhou Zhang
|
200944b415
|
Update kernel installation instructions after shifting default cuda to 13 (#24181)
|
2026-05-02 16:07:20 -07:00 |
|
|
|
88bb5dffe4
|
[Dependency] Upgrade to Torch 2.11.0 (#21247)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-05-02 12:25:36 -07:00 |
|
|
|
24a6b3084d
|
[CI] drop --prerelease allow from uv pip install suffix (#24265)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-05-02 12:25:01 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
d74d9bda49
|
[gateway] Align /v1/loads and /model_info with sglang server; drop dead /rerank (#24167)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-02 11:43:30 -07:00 |
|
|
Glen LiuandEthan Su
|
e0474fdd9b
|
throw ValueError for DoRA adapters (#22125)
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
|
2026-05-02 14:54:19 +00:00 |
|
|
Xiaoyu Zhang
|
4128f1ffe2
|
[SKILLS] Tiny upgrade diffusion skills (#24273)
|
2026-05-02 22:04:05 +08:00 |
|
|
Xiaoyu Zhang
|
b712dd48fe
|
[codex] diffusion: enable group norm silu fuse by default (#23148)
|
2026-05-02 20:55:51 +08:00 |
|
|
Xiaoyu Zhang
|
1360848ee1
|
Optimize large GroupNorm SiLU apply (#23938)
|
2026-05-02 20:54:46 +08:00 |
|
|
egvenediktovandronnie_zheng
|
83bf5d6869
|
[NPU]TP Communications compression For Qwen3 models for NPU (#20520)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-02 14:29:11 +03:00 |
|
|
|
ebbaab5597
|
[NPU] Add GitHub test summary and deduplicate test code. Part 1 (#23835)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-02 14:18:18 +03:00 |
|
|
|
3259a2c789
|
Encode routed_experts in the detokenizer, off the tokenizer hot path (#24263)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Yueming Yuan <yym022502@gmail.com>
|
2026-05-02 02:44:32 -07:00 |
|
|
Xiaoyu Zhang
|
589f90b368
|
[diffusion] chore: use lmsys as org for modelopt checkpoints (#23924)
|
2026-05-02 17:18:58 +08:00 |
|
|
Alison Shao
|
f3dbadb82b
|
fix: accept 0-indexed safetensors shard names in CI weight validator (#24237)
|
2026-05-02 00:58:15 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
2e72a36420
|
[CI] Restore SMG e2e on 2-gpu-h100 / 4-gpu-h100 runners (#24222)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-01 23:55:20 -07:00 |
|
|
billishyahao
|
b939d5410f
|
[AMD] enable sdma for moriep unittest (#24259)
|
2026-05-01 23:34:53 -07:00 |
|
|
Clayandchengyusong1
|
5ec3b26799
|
[diffusion] model: support JoyAI-Image-Edit (#22625)
Co-authored-by: chengyusong1 <chengyusong1@jd.com>
|
2026-05-02 14:08:57 +08:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
cd27baaffd
|
[ci][cu13] Bump torch_memory_saver to 0.0.9.post1; restore manual tests (#23182)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-01 22:50:38 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
674a80d5d8
|
[CI] Add 1-gpu-h100-h200 to rerun-test runner_label choices (#24264)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-01 22:45:48 -07:00 |
|
|
Mick
|
b7d4647568
|
[diffusion] CI: change ground truth repo (#24219)
|
2026-05-01 21:25:40 -07:00 |
|
|
Sam Shleifer
|
63f225ca2e
|
[session] fix mamba pool leak in StreamingSession.release_session + plumb idle leak check (#23496)
|
2026-05-02 11:38:08 +08:00 |
|
|
|
d41e8c459d
|
Support RunAI loading for quantized checkpoints (#23850)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Sam Shleifer <sam@thinkingmachines.ai>
|
2026-05-02 11:11:40 +08:00 |
|
|
Xiaoyu Zhang
|
321298da75
|
[SKILL] Upgrade sglang profile and auto_benchmark skills (#24250)
|
2026-05-02 10:12:47 +08:00 |
|