 Kangyan-ZhouandClaude Opus 4.7
|
0f283a515a
|
[Docker] fix: install nixl stub alongside nixl-cuXX binary (#24369)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-04 12:46:38 -07:00 |
|
|
Vladislav Nosivskoy
|
60a1dacd89
|
[HiCache] return cached_tokens_details in sglext for streaming responses (#22055)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
|
2026-05-04 12:30:17 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
8ffd39e140
|
[CI] Exclude flaky h20 stage from check-stage-health root cause set (#24374)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-04 11:41:25 -07:00 |
|
|
Ke Bao
|
6dd7aebb36
|
Minor scheduler fixes (#24359)
|
2026-05-05 02:01:23 +08:00 |
|
|
Sam Shleifer
|
e6f252e9b8
|
Cache FlashInfer autotune configs (#24156)
|
2026-05-05 02:00:40 +08:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
c545a5b1c0
|
[SMG][CI] Add K8s integration tests + wire into pr-test-rust (#24278)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-04 10:27:37 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
e5c58eb9d6
|
[VLM] Optimize Gemma4 VLM with PCG and fuse RMSNorm + residual add + scalar (#24048)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-04 09:36:26 -07:00 |
|
|
Mick
|
1be3163011
|
[diffusion] fix: use direct all-to-all for USP collectives (#24366)
|
2026-05-05 00:08:48 +08:00 |
|
|
mispa-msandClaude Opus 4.7
|
62a4df0067
|
[docker] Fix silently-masked cubin download failure; skip prebuilt cubins on aarch64 (#24234)
Signed-off-by: misunp <misunp@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-04 09:08:01 -07:00 |
|
|
Xiaoyu Zhang
|
4b6d44641b
|
[diffusion] chore: enable channels-last 3D VAE convs by default (#23200)
|
2026-05-04 22:59:31 +08:00 |
|
|
Zhangheng
|
05aed5e1d5
|
[UnifiedRadixTree]: Add KL accuracy CI for UnifiedTree with HiCache (#24346)
|
2026-05-04 20:18:10 +08:00 |
|
|
Liangsheng Yin
|
84f3b44916
|
[tiny] misc cleanups across configs, attention, jit_kernel (#24350)
|
2026-05-04 03:17:14 -07:00 |
|
|
|
952b3caf18
|
feat: use structural tags to enable strict tool calling and reasoning for more models (#21722)
Signed-off-by: Yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-05-04 02:30:28 -07:00 |
|
|
Khoa Pham
|
ef2b1b6d89
|
Fix flashinfer workspace OOM (#24172)
|
2026-05-04 01:26:35 -07:00 |
|
|
Baizhou ZhangandClaude Opus 4.7
|
de08c804c5
|
Add release workflow for sgl-deep-gemm wheels (#24348)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-04 00:58:44 -07:00 |
|
|
|
52b4609789
|
[Docker] Prep for torch 2.11: cu129 fix, image validator, dep cleanup (#23593)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-05-04 00:37:55 -07:00 |
|
|
Bingxu ChenandYC Yen-Ching Tseng
|
5eff3c489a
|
[AMD] Deepseek v4 Flash / Pro nightly tests for MI35x ROCm 7.2 (#24203)
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
|
2026-05-04 00:02:33 -07:00 |
|
|
Ke Bao
|
aea527afdc
|
Fix swa chunk req deferred (#24318)
|
2026-05-04 14:52:15 +08:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
c2d60c3667
|
chore(codeowners): add @kpham-sgl as codeowner for ngram files (#24349)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-03 23:27:33 -07:00 |
|
|
Liangsheng Yin
|
a91ae6af9e
|
nextn subclass owns post_load_weights is_nextn (#24333)
|
2026-05-03 22:04:44 -07:00 |
|
|
Liangsheng Yin
|
1dd8f6d5ae
|
dedup state_kv_args setup into helper (#24340)
|
2026-05-03 20:45:26 -07:00 |
|
|
Liangsheng Yin
|
91fa2340ed
|
extract adjust_hybrid_swa_layers_for_pp (#24334)
|
2026-05-03 18:52:54 -07:00 |
|
|
Ethan (Yusheng) Su
|
b7fefc0e85
|
feat(lora): enable csgmv backend with virtual experts for MoE LoRA (#24007)
|
2026-05-03 18:44:17 -07:00 |
|
|
Mick
|
c611a3fb78
|
[diffusion] chore: disable VAE cpu offload by default (#24315)
|
2026-05-04 08:24:51 +08:00 |
|
|
Liangsheng Yin
|
00d620b77d
|
introduce arg_groups/ with nemotron_h hook (#24328)
|
2026-05-03 16:28:11 -07:00 |
|
|
Liangsheng Yin
|
c3b6d20a80
|
Register deepseek_v32 alias instead of rewriting config.json (#24295)
|
2026-05-03 16:02:17 -07:00 |
|
|
Liangsheng Yin
|
53df43d0a3
|
rerun-test: route deepep h200 suite to deepep runner (#24325)
|
2026-05-03 15:57:53 -07:00 |
|
|
ZhanghengandShangming Cai
|
9a5450ad73
|
[PD]: Support incremental transfer for mooncake transfer engine (#24257)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-04 00:57:59 +08:00 |
|
|
Chi McIsaacandJunhao Liu
|
62265ca7fc
|
[diffusion] feat: initial support for dynamic batching (#18764)
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Junhao Liu <junhaoliu2023@gmail.com>
|
2026-05-04 00:44:42 +08:00 |
|
|
Xiaoyu ZhangandMick
|
f2d1390909
|
[Diffusion] Add Qwen Image ModelOpt FP8 support (#23155)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-05-04 00:24:22 +08:00 |
|
|
Mick
|
5925572c95
|
[diffusion] CI: switch CI data references to sgl-project/ci-data (#24299)
|
2026-05-03 23:05:12 +08:00 |
|
|
|
c0f5950636
|
[UnifiedRadixTree]: Support HiCache Framework for UnifiedRadixTree (#23316)
Co-authored-by: JINZ <1023553676@qq.com>
Co-authored-by: diemchai <diemchai@tencent.com>
|
2026-05-03 22:13:22 +08:00 |
|
|
GXINandronnie_zheng
|
e37f46fcf7
|
[NPU] Fix Z-Image negative-branch rotary embeddings for CFG (#23538)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-03 16:18:26 +03:00 |
|
|
ZhanghengandShangming Cai
|
44ca2d01fc
|
[pd]: (Bug Fix) Incorrect out_cache_loc slicing in prepare_for_prebuilt (#24230)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-03 18:35:16 +08:00 |
|
|
Mick
|
2bfc5d3bb1
|
[diffusion] optimize LTX2.3 HQ denoising split passes (#24298)
|
2026-05-03 16:37:46 +08:00 |
|
|
Mick
|
8b12367b92
|
[diffusion] CI: add diffusion GT generation (official implementation) to the workflow (#24270)
|
2026-05-03 15:10:35 +08:00 |
|
|
Liangsheng YinandDarkSharpness
|
fcc8b7b126
|
Rename SGLANG_USE_JIT_ALL_REDUCE to SGLANG_OPT_USE_CUSTOM_ALL_REDUCE_V2 (#24297)
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-05-02 23:59:46 -07:00 |
|
|
Mohammad Miadh Angkad
|
b7d8ceb444
|
[CI] Keep custom sgl-kernel wheel in CUDA CI (#24291)
|
2026-05-02 21:53:21 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
266d994368
|
[CI] Fix nightly NV jobs cancelling each other via shared concurrency groups (#24282)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-02 21:53:03 -07:00 |
|
|
Glen Liu
|
76b9c8de6f
|
[Feature] add LoRADrainer to address high P99 TTFT (#17913)
|
2026-05-02 16:13:43 -07:00 |
|
|
Baizhou Zhang
|
200944b415
|
Update kernel installation instructions after shifting default cuda to 13 (#24181)
|
2026-05-02 16:07:20 -07:00 |
|
|
|
88bb5dffe4
|
[Dependency] Upgrade to Torch 2.11.0 (#21247)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-05-02 12:25:36 -07:00 |
|
|
|
24a6b3084d
|
[CI] drop --prerelease allow from uv pip install suffix (#24265)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-05-02 12:25:01 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
d74d9bda49
|
[gateway] Align /v1/loads and /model_info with sglang server; drop dead /rerank (#24167)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-02 11:43:30 -07:00 |
|
|
Glen LiuandEthan Su
|
e0474fdd9b
|
throw ValueError for DoRA adapters (#22125)
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
|
2026-05-02 14:54:19 +00:00 |
|
|
Xiaoyu Zhang
|
4128f1ffe2
|
[SKILLS] Tiny upgrade diffusion skills (#24273)
|
2026-05-02 22:04:05 +08:00 |
|
|
Xiaoyu Zhang
|
b712dd48fe
|
[codex] diffusion: enable group norm silu fuse by default (#23148)
|
2026-05-02 20:55:51 +08:00 |
|
|
Xiaoyu Zhang
|
1360848ee1
|
Optimize large GroupNorm SiLU apply (#23938)
|
2026-05-02 20:54:46 +08:00 |
|
|
egvenediktovandronnie_zheng
|
83bf5d6869
|
[NPU]TP Communications compression For Qwen3 models for NPU (#20520)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-02 14:29:11 +03:00 |
|
|
|
ebbaab5597
|
[NPU] Add GitHub test summary and deduplicate test code. Part 1 (#23835)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-02 14:18:18 +03:00 |
|