18694 Commits
Author SHA1 Message Date
jasonjk-park 3c2956d880 Add extension points on SpeculativeAlgorithm for custom spec v2 (#24999) 2026-05-15 15:45:31 -07:00
Xinyuan Tong 7cb4669a04 [Fix] DeepSeek-V3.2: build structural tag locally to encode both wrapper and invoke layers (#25233) 2026-05-15 14:32:50 -07:00
Liangsheng Yin 494ee71189 split test_dsa_models_mtp into 4 files (#25318) 2026-05-15 14:16:57 -07:00
Liangsheng Yin f9caf43095 [CI] slash handler: lookup runs_on from runner_configs.yml (#25394) 2026-05-15 13:59:00 -07:00
Cheng WanandClaude Opus 4.7 54221dd998 feat(moe): reuse prev-layer output as symm_output for FP4 routed MoE (#25379)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-15 12:05:40 -07:00
Xinyuan Tong 33f1d3915f [NEW MODEL] Add H200 validation for Ring-2.6-1T cookbook (#25370) 2026-05-15 11:47:15 -07:00
Alex Nails 4df42da658 Introduce CudaDeviceMixin and CudaSRTPlatform (#24096) 2026-05-15 10:59:02 -07:00
Cheng WanandClaude Opus 4.7 ee93795476 perf(mla): hybrid Triton fused cat+FP8-quantize for MLA chunked-prefill K/V (#25333)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-15 10:51:00 -07:00
Kai-Hsun ChenandClaude Opus 4.7 17c8a2fa53 [Llama4] Use strided in-place fused QK RMSNorm to drop a redundant copy (#25089)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-15 10:33:08 -07:00
Zhangheng 21b3ac52b4 [UnifiedTree]: Fix UnifiedRadixCache device match semantics with HiCache (#25277) 2026-05-16 00:40:55 +08:00
Cheng Wan 3f7e538b2f Add NPU condition for cosine and sine caching (#25399) 2026-05-15 05:21:53 -07:00
Liangsheng Yin fd9525436b move runs_on + rdma into runner_configs.yml (#25264) 2026-05-15 04:19:13 -07:00
Liangsheng Yin 293027aafa pr-states: fix fork-PR token + add run-ci label awareness (#25392) 2026-05-15 04:09:15 -07:00
Liangsheng Yin 3117415c9b ci: standalone PR awareness workflow (decouple from pr-test reusable chain) (#25387) 2026-05-15 03:20:00 -07:00
Chi McIsaac 20123e0b16 [diffusion] fix: mount Cache-DiT before torch.compile in native denoising (#25328) 2026-05-15 18:08:39 +08:00
liuxianglong17 eec5ba26cf Fix incorrect import in test case (#25080) 2026-05-15 17:35:57 +08:00
Liangsheng Yin eff736cc0f Deprecate /rerun-stage; scrub CUDA target_stage infra (#25322) 2026-05-15 02:18:28 -07:00
Baizhou Zhang 1a1d69507d [Doc] Update MegaMoE usage (#25378) 2026-05-15 02:17:50 -07:00
Zhangheng fe7a5dd3bf [UnifiedTree]: Add nightly hicache ci for dsa model (#25348) 2026-05-15 16:54:50 +08:00
nohup 34cb8e2842 fix(sgl-kernel): sm90 compile flashmla failed (#24130) 2026-05-15 16:42:33 +08:00
zhaochen zhang 12408ec668 [Disagg] Add retry with exponential backoff for prefill bootstrap reg… (#25125) 2026-05-15 16:38:51 +08:00
0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
2026-05-15 01:04:56 -07:00
4adfc6cf7e ci: dispatch pr-test-extra.yml from pr-test.yml on the scheduled cron (#25320)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-15 01:01:23 -07:00
shuwennandClaude Opus 4.7 66ef97c00f [Lint] Fix Optional[X] = (None,) typo defaults in two dataclasses (#25252)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-15 00:32:40 -07:00
Xiaoyu ZhangandBBuf Codex aaaad9e7c2 [Codex] Diffusion tune Hunyuan3D shape export chunks (#24358)
Co-authored-by: BBuf Codex <bbuf-codex@users.noreply.github.com>
2026-05-15 15:31:01 +08:00
Michael 9dad37f254 [AMD] Bump --timeout-per-file 1800->2400 for stage-b-test-1-gpu-small-amd (#25112) 2026-05-15 15:10:04 +08:00
Zhangheng c7e879e43f Add hicache feature in dsv4 cookbook (#25369) 2026-05-15 00:06:44 -07:00
Xinyuan Tong c3daa77e9a [NEW MODEL] Add Ring-2.6-1T cookbook (#25360) 2026-05-14 23:32:22 -07:00
Chi McIsaac 4b6b434dfe [diffusion] fix: fix Z-Image Cache-DiT sequence-parallel override (#25305) 2026-05-15 13:25:00 +08:00
WenhaoZhangandniehen6174 6cfa4c9c2f [diffusion] fix: respect dit_precision config instead of hardcoded bfloat16 in DenoisingStagge (#24988)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
2026-05-15 13:22:24 +08:00
Cheng WanandClaude Opus 4.7 ad4994dc1d DeepseekV2MoE: defer shared experts when routed kernel is non-mutating (#25279)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-14 22:20:55 -07:00
897587b03a [MUSA]: Add flashinfer sampling backend (#24978)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
2026-05-14 20:23:15 -07:00
d9fa84b25b [UnifiedTree]: Support HiCache For DeepSeek_V4 (#24691)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
2026-05-14 20:20:52 -07:00
Kangyan-Zhou 974948a701 fix: strip "[asctime]" prefix when parsing JSON log lines in nightly tests (#25340) 2026-05-14 20:17:13 -07:00
Liangsheng Yin d89b678d69 move dead sglang.test files to test/manual (#25316) 2026-05-14 20:02:44 -07:00
YAMY 8d5b347edd Support Qwen3.5 NVFP4 MTP DeepEP (#24906) 2026-05-15 10:49:14 +08:00
Qiaolin Yu 7af4320d67 [perf] fix kimi tokenizer to improve ttft (#25265) 2026-05-14 19:11:25 -07:00
Cheng Wan dca9ba6321 perf(mla): TMA bulk-store set_mla_kv_buffer (up to 12× over baseline) (#25311) 2026-05-14 18:23:41 -07:00
Cheng WanandClaude Opus 4.7 1913cb4dbb Skip CI tests added in #24816 (broken on main) (#25329)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-14 18:12:13 -07:00
sglang-botandsglang-bot 0fde61535f chore: bump sgl-kernel version to 0.4.2.post2 (#25326)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-05-14 17:53:17 -07:00
Haoguang CaiandClaude Sonnet 4.6 626fd61308 📝 docs: add canonical URL to fix Google indexing lmsysorg.mintlify.app instead of docs.sglang.io (#24935)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-14 16:46:40 -07:00
ba214ef3d3 ci: tag-gated nightly migration — foundation + 40 whole-file moves (#24725)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-14 16:11:15 -07:00
Liangsheng Yin 67096f48bf Revert "[MoE] Decouple Mega MoE from DeepEP backend" (#25317) 2026-05-14 16:00:41 -07:00
Charles Chen 78408d2300 Fix frozen kv MTP crash when bonus_tokens is None (#25204) 2026-05-14 15:33:55 -07:00
Liangsheng Yin 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) 2026-05-14 15:28:58 -07:00
Yuhao Yang 88d3ed7df1 Enable SGLANG_OPT_FP8_WO_A_GEMM by default (#25181) 2026-05-15 02:09:13 +08:00
Yuhao Yang 37f030a0de [MoE] Decouple Mega MoE from DeepEP backend (#24884) 2026-05-15 02:01:44 +08:00
Le ZhangandClaude Opus 4.7 3fc60e5748 [MLX] bench_one_batch: thread --quantization through to MlxModelRunner (#25221)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-14 09:56:42 -07:00
Jae B. 90afd680f3 [Apple Silicon] [MLX] Auto-detect MLX-format quantization_config dict (#25191) 2026-05-14 09:55:37 -07:00
Jialin Ouyang 50f405816e ci: add Jialin to CI permissions (custom override) (#25234) 2026-05-14 02:54:07 -07:00