minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
18,707 Commits 4 Branches 0 Tags
dsv41-pd-visioncp
Commit Graph
18707 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
fzyzcjy 80c3ce3204 Convert forward_pass_device_timer to None-init (#25438) 2026-05-16 09:20:31 +08:00
Lianmin ZhengandHanming Lu 21e420b4c2 [Test] Set default temperature to 0.0 in kl_test_utils (#25429) 
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
 2026-05-15 18:20:10 -07:00
fzyzcjy 40429248c8 Drop dead hasattr guards (hisparse_coordinator, metrics_collector) (#25437) 2026-05-16 09:19:56 +08:00
fzyzcjy 0071033ff6 Cache _linear_attn_registry_cache with sentinel (#25436) 2026-05-16 09:19:21 +08:00
fzyzcjy 6a1b05d706 Replace single-line defensive getattrs with direct access (#25435) 2026-05-16 09:18:43 +08:00
fzyzcjy 27c3190215 Remove fields that are never used in spec/engine/disagg (#25434) 2026-05-16 09:18:00 +08:00
fzyzcjy e065445236 Remove managers' unused fields (#25433) 2026-05-16 09:17:11 +08:00
fzyzcjy 33d63aa7e1 Remove dead self.adder/can_run_list/running_bs writes in Scheduler._get_new_batch_prefill_raw (#25432) 2026-05-16 09:12:39 +08:00
fzyzcjy 824ad24149 Convert local-only self.X attributes to locals (#25430) 2026-05-16 09:05:43 +08:00
Yuhao Yang 18c16f8660 Port SGLANG_OPT_SWA_EVICT_DROP_PAGE_MARGIN from deepseek_v4_dev (#25419) 2026-05-15 17:39:13 -07:00
Brayden Zhongandb8zhong d523ae127f Fix Mistral Large 3 nightly test (#25407) 
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
 2026-05-15 17:28:35 -07:00
Yuhao YangybyangShangming Cai
 		5ba69f50fb Add multi-detokenizer support (#24944) 
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-05-15 17:26:26 -07:00
Hanming Lu afc7c9f7f3 [TRTLLM/SWA/Spec] fix trtllm mha + swa + spec accept length drop (#25103) 2026-05-15 17:15:31 -07:00
jasonjk-park 3c2956d880 Add extension points on SpeculativeAlgorithm for custom spec v2 (#24999) 2026-05-15 15:45:31 -07:00
Xinyuan Tong 7cb4669a04 [Fix] DeepSeek-V3.2: build structural tag locally to encode both wrapper and invoke layers (#25233) 2026-05-15 14:32:50 -07:00
Liangsheng Yin 494ee71189 split test_dsa_models_mtp into 4 files (#25318) 2026-05-15 14:16:57 -07:00
Liangsheng Yin f9caf43095 [CI] slash handler: lookup runs_on from runner_configs.yml (#25394) 2026-05-15 13:59:00 -07:00
Cheng WanandClaude Opus 4.7 54221dd998 feat(moe): reuse prev-layer output as symm_output for FP4 routed MoE (#25379) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-15 12:05:40 -07:00
Xinyuan Tong 33f1d3915f [NEW MODEL] Add H200 validation for Ring-2.6-1T cookbook (#25370) 2026-05-15 11:47:15 -07:00
Alex Nails 4df42da658 Introduce CudaDeviceMixin and CudaSRTPlatform (#24096) 2026-05-15 10:59:02 -07:00
Cheng WanandClaude Opus 4.7 ee93795476 perf(mla): hybrid Triton fused cat+FP8-quantize for MLA chunked-prefill K/V (#25333) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-15 10:51:00 -07:00
Kai-Hsun ChenandClaude Opus 4.7 17c8a2fa53 [Llama4] Use strided in-place fused QK RMSNorm to drop a redundant copy (#25089) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-15 10:33:08 -07:00
Zhangheng 21b3ac52b4 [UnifiedTree]: Fix UnifiedRadixCache device match semantics with HiCache (#25277) 2026-05-16 00:40:55 +08:00
Cheng Wan 3f7e538b2f Add NPU condition for cosine and sine caching (#25399) 2026-05-15 05:21:53 -07:00
Liangsheng Yin fd9525436b move runs_on + rdma into runner_configs.yml (#25264) 2026-05-15 04:19:13 -07:00
Liangsheng Yin 293027aafa pr-states: fix fork-PR token + add run-ci label awareness (#25392) 2026-05-15 04:09:15 -07:00
Liangsheng Yin 3117415c9b ci: standalone PR awareness workflow (decouple from pr-test reusable chain) (#25387) 2026-05-15 03:20:00 -07:00
Chi McIsaac 20123e0b16 [diffusion] fix: mount Cache-DiT before torch.compile in native denoising (#25328) 2026-05-15 18:08:39 +08:00
liuxianglong17 eec5ba26cf Fix incorrect import in test case (#25080) 2026-05-15 17:35:57 +08:00
Liangsheng Yin eff736cc0f Deprecate /rerun-stage; scrub CUDA target_stage infra (#25322) 2026-05-15 02:18:28 -07:00
Baizhou Zhang 1a1d69507d [Doc] Update MegaMoE usage (#25378) 2026-05-15 02:17:50 -07:00
Zhangheng fe7a5dd3bf [UnifiedTree]: Add nightly hicache ci for dsa model (#25348) 2026-05-15 16:54:50 +08:00
nohup 34cb8e2842 fix(sgl-kernel): sm90 compile flashmla failed (#24130) 2026-05-15 16:42:33 +08:00
zhaochen zhang 12408ec668 [Disagg] Add retry with exponential backoff for prefill bootstrap reg… (#25125) 2026-05-15 16:38:51 +08:00
Baizhou Zhangsglang-botb8zhongmmangkad
 		0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
 2026-05-15 01:04:56 -07:00
Alison Shaohnyls2002Liangsheng Yin
 		4adfc6cf7e ci: dispatch pr-test-extra.yml from pr-test.yml on the scheduled cron (#25320) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-05-15 01:01:23 -07:00
shuwennandClaude Opus 4.7 66ef97c00f [Lint] Fix Optional[X] = (None,) typo defaults in two dataclasses (#25252) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-15 00:32:40 -07:00
Xiaoyu ZhangandBBuf Codex aaaad9e7c2 [Codex] Diffusion tune Hunyuan3D shape export chunks (#24358) 
Co-authored-by: BBuf Codex <bbuf-codex@users.noreply.github.com>
 2026-05-15 15:31:01 +08:00
Michael 9dad37f254 [AMD] Bump --timeout-per-file 1800->2400 for stage-b-test-1-gpu-small-amd (#25112) 2026-05-15 15:10:04 +08:00
Zhangheng c7e879e43f Add hicache feature in dsv4 cookbook (#25369) 2026-05-15 00:06:44 -07:00
Xinyuan Tong c3daa77e9a [NEW MODEL] Add Ring-2.6-1T cookbook (#25360) 2026-05-14 23:32:22 -07:00
Chi McIsaac 4b6b434dfe [diffusion] fix: fix Z-Image Cache-DiT sequence-parallel override (#25305) 2026-05-15 13:25:00 +08:00
WenhaoZhangandniehen6174 6cfa4c9c2f [diffusion] fix: respect dit_precision config instead of hardcoded bfloat16 in DenoisingStagge (#24988) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
 2026-05-15 13:22:24 +08:00
Cheng WanandClaude Opus 4.7 ad4994dc1d DeepseekV2MoE: defer shared experts when routed kernel is non-mutating (#25279) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-14 22:20:55 -07:00
origithub-actions[bot]zhiguo.qinR0CKSTAR
 		897587b03a [MUSA]: Add flashinfer sampling backend (#24978) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
 2026-05-14 20:23:15 -07:00
Zhanghengispobock晟海
 		d9fa84b25b [UnifiedTree]: Support HiCache For DeepSeek_V4 (#24691) 
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
 2026-05-14 20:20:52 -07:00
Kangyan-Zhou 974948a701 fix: strip "[asctime]" prefix when parsing JSON log lines in nightly tests (#25340) 2026-05-14 20:17:13 -07:00
Liangsheng Yin d89b678d69 move dead sglang.test files to test/manual (#25316) 2026-05-14 20:02:44 -07:00
YAMY 8d5b347edd Support Qwen3.5 NVFP4 MTP DeepEP (#24906) 2026-05-15 10:49:14 +08:00
Qiaolin Yu 7af4320d67 [perf] fix kimi tokenizer to improve ttft (#25265) 2026-05-14 19:11:25 -07:00