minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
18,675 Commits 4 Branches 0 Tags
main
Commit Graph
18675 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
nohup 34cb8e2842 fix(sgl-kernel): sm90 compile flashmla failed (#24130) 2026-05-15 16:42:33 +08:00
zhaochen zhang 12408ec668 [Disagg] Add retry with exponential backoff for prefill bootstrap reg… (#25125) 2026-05-15 16:38:51 +08:00
Baizhou Zhangsglang-botb8zhongmmangkad
 		0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
 2026-05-15 01:04:56 -07:00
Alison Shaohnyls2002Liangsheng Yin
 		4adfc6cf7e ci: dispatch pr-test-extra.yml from pr-test.yml on the scheduled cron (#25320) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-05-15 01:01:23 -07:00
shuwennandClaude Opus 4.7 66ef97c00f [Lint] Fix Optional[X] = (None,) typo defaults in two dataclasses (#25252) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-15 00:32:40 -07:00
Xiaoyu ZhangandBBuf Codex aaaad9e7c2 [Codex] Diffusion tune Hunyuan3D shape export chunks (#24358) 
Co-authored-by: BBuf Codex <bbuf-codex@users.noreply.github.com>
 2026-05-15 15:31:01 +08:00
Michael 9dad37f254 [AMD] Bump --timeout-per-file 1800->2400 for stage-b-test-1-gpu-small-amd (#25112) 2026-05-15 15:10:04 +08:00
Zhangheng c7e879e43f Add hicache feature in dsv4 cookbook (#25369) 2026-05-15 00:06:44 -07:00
Xinyuan Tong c3daa77e9a [NEW MODEL] Add Ring-2.6-1T cookbook (#25360) 2026-05-14 23:32:22 -07:00
Chi McIsaac 4b6b434dfe [diffusion] fix: fix Z-Image Cache-DiT sequence-parallel override (#25305) 2026-05-15 13:25:00 +08:00
WenhaoZhangandniehen6174 6cfa4c9c2f [diffusion] fix: respect dit_precision config instead of hardcoded bfloat16 in DenoisingStagge (#24988) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
 2026-05-15 13:22:24 +08:00
Cheng WanandClaude Opus 4.7 ad4994dc1d DeepseekV2MoE: defer shared experts when routed kernel is non-mutating (#25279) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-14 22:20:55 -07:00
origithub-actions[bot]zhiguo.qinR0CKSTAR
 		897587b03a [MUSA]: Add flashinfer sampling backend (#24978) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
 2026-05-14 20:23:15 -07:00
Zhanghengispobock晟海
 		d9fa84b25b [UnifiedTree]: Support HiCache For DeepSeek_V4 (#24691) 
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
 2026-05-14 20:20:52 -07:00
Kangyan-Zhou 974948a701 fix: strip "[asctime]" prefix when parsing JSON log lines in nightly tests (#25340) 2026-05-14 20:17:13 -07:00
Liangsheng Yin d89b678d69 move dead sglang.test files to test/manual (#25316) 2026-05-14 20:02:44 -07:00
YAMY 8d5b347edd Support Qwen3.5 NVFP4 MTP DeepEP (#24906) 2026-05-15 10:49:14 +08:00
Qiaolin Yu 7af4320d67 [perf] fix kimi tokenizer to improve ttft (#25265) 2026-05-14 19:11:25 -07:00
Cheng Wan dca9ba6321 perf(mla): TMA bulk-store set_mla_kv_buffer (up to 12× over baseline) (#25311) 2026-05-14 18:23:41 -07:00
Cheng WanandClaude Opus 4.7 1913cb4dbb Skip CI tests added in #24816 (broken on main) (#25329) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-14 18:12:13 -07:00
sglang-botandsglang-bot 0fde61535f chore: bump sgl-kernel version to 0.4.2.post2 (#25326) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-05-14 17:53:17 -07:00
Haoguang CaiandClaude Sonnet 4.6 626fd61308 📝 docs: add canonical URL to fix Google indexing lmsysorg.mintlify.app instead of docs.sglang.io (#24935) 
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
 2026-05-14 16:46:40 -07:00
Alison Shaohnyls2002Liangsheng Yin
 		ba214ef3d3 ci: tag-gated nightly migration — foundation + 40 whole-file moves (#24725) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-05-14 16:11:15 -07:00
Liangsheng Yin 67096f48bf Revert "[MoE] Decouple Mega MoE from DeepEP backend" (#25317) 2026-05-14 16:00:41 -07:00
Charles Chen 78408d2300 Fix frozen kv MTP crash when bonus_tokens is None (#25204) 2026-05-14 15:33:55 -07:00
Liangsheng Yin 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) 2026-05-14 15:28:58 -07:00
Yuhao Yang 88d3ed7df1 Enable SGLANG_OPT_FP8_WO_A_GEMM by default (#25181) 2026-05-15 02:09:13 +08:00
Yuhao Yang 37f030a0de [MoE] Decouple Mega MoE from DeepEP backend (#24884) 2026-05-15 02:01:44 +08:00
Le ZhangandClaude Opus 4.7 3fc60e5748 [MLX] bench_one_batch: thread --quantization through to MlxModelRunner (#25221) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-14 09:56:42 -07:00
Jae B. 90afd680f3 [Apple Silicon] [MLX] Auto-detect MLX-format quantization_config dict (#25191) 2026-05-14 09:55:37 -07:00
Jialin Ouyang 50f405816e ci: add Jialin to CI permissions (custom override) (#25234) 2026-05-14 02:54:07 -07:00
Liangsheng Yin 4593bbdf31 ci: dynamic partition + LPT from live sglang-ci-stats model (#25263) 2026-05-14 02:35:59 -07:00
amote-i 373a22c225 [NPU] [DOC] fix issues in ascend npu docs (#25268) 2026-05-14 17:25:47 +08:00
Xingyu Liu 2279b79f35 Add --model-config-parser registry for pluggable config formats (#25050) 
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
 2026-05-14 01:54:06 -07:00
YAMY 4be25f2428 fix(disagg): broadcast bootstrap port across multi-node prefill ranks (#24378) 2026-05-14 16:39:01 +08:00
Liangsheng Yin 2417a9da57 [CI] Bundle check-changes outputs + caller inputs into 2 JSON inputs (#25238) 2026-05-14 01:02:01 -07:00
Liangsheng Yin d311f311bc ci: read est_time from sglang-ci-stats instead of scraping CI logs (#25255) 2026-05-14 00:36:25 -07:00
Hsiu-Chun, Hunggithub-actions[bot]YC Yen-Ching Tseng
 		bc265c5f82 [AMD] Add amd jit resolve token ids bench ci (#25210) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
 2026-05-14 00:13:12 -07:00
Hsiu-Chun, Hunggithub-actions[bot]YC Yen-Ching Tseng
 		7b128e143a [AMD] Add amd jit clamp position bench ci (#25209) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
 2026-05-14 00:03:56 -07:00
Yihao Wang 41eb2d861b [fix] load_audio: fall back to soundfile when torchcodec fails on WAV with trailing metadata (#24185) 2026-05-14 15:02:49 +08:00
YC Yen-Ching Tseng 22bfae0d1d [AMD] Auto-fallback NSA indexer to page_size=1 when aiter preshuffle gluon kernel is unavailable (Deepseek v3.2) (#25205) 2026-05-14 00:01:56 -07:00
Liangsheng Yin 142ed710b7 [CI] Support new-style register_cuda_ci(stage=, runner_config=) in slash handler + est-time updater (#25248) 2026-05-13 23:53:49 -07:00
Qiaolin Yu 421179c453 [perf] avoid hidden states d2h when return_hidden_states=false (#25155) 2026-05-13 23:47:17 -07:00
zijiexiaandClaude Opus 4.7 1f119f6a44 [Docs] update dsv4 cookbook with H100 deployment commands (#25243) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-13 23:45:29 -07:00
Lewisand百麒 0680f1b3d1 Add IntraNode NVLink configration in PD disaggregation docs (#23329) 
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
 2026-05-13 23:23:57 -07:00
AndyLi429 3640116397 [NPU]Bugfix:Set default values for npu_wrapper_preprocess parameters (#25130) 2026-05-14 14:21:11 +08:00
Teng Macopilot-swe-agent[bot]stmatengssZhangheng
 		be156d6804 [HiCache] enable ssd offload support for mooncake store (#24277) 
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: stmatengss <11641725+stmatengss@users.noreply.github.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
 2026-05-13 23:07:02 -07:00
Alison Shao 36c9495aaa ci: H200 conditional split + dsv4 est_time recalibration (h200 partition 6→2) (#25236) 2026-05-13 22:28:37 -07:00
Ke Bao e4378ff37f [UnifiedRadixCache] Fix HiCache load back start node (#25088) 2026-05-14 13:18:12 +08:00
Tejas Dharamsi c016246b0f [Rerank] Early-exit logprob scan and hoist math import (#25046) 2026-05-13 22:01:07 -07:00