Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 5c440cdc41 Lift running_batch / running_mbs access — direct + PP-explicit (#25439) fzyzcjy 2026-05-16 09:21:00 +08:00
• 80c3ce3204 Convert forward_pass_device_timer to None-init (#25438) fzyzcjy 2026-05-16 09:20:31 +08:00
• 21e420b4c2 [Test] Set default temperature to 0.0 in kl_test_utils (#25429) Lianmin ZhengandHanming Lu 2026-05-15 18:20:10 -07:00
• 40429248c8 Drop dead hasattr guards (hisparse_coordinator, metrics_collector) (#25437) fzyzcjy 2026-05-16 09:19:56 +08:00
• 0071033ff6 Cache _linear_attn_registry_cache with sentinel (#25436) fzyzcjy 2026-05-16 09:19:21 +08:00
• 6a1b05d706 Replace single-line defensive getattrs with direct access (#25435) fzyzcjy 2026-05-16 09:18:43 +08:00
• 27c3190215 Remove fields that are never used in spec/engine/disagg (#25434) fzyzcjy 2026-05-16 09:18:00 +08:00
• e065445236 Remove managers' unused fields (#25433) fzyzcjy 2026-05-16 09:17:11 +08:00
• 33d63aa7e1 Remove dead self.adder/can_run_list/running_bs writes in Scheduler._get_new_batch_prefill_raw (#25432) fzyzcjy 2026-05-16 09:12:39 +08:00
• 824ad24149 Convert local-only self.X attributes to locals (#25430) fzyzcjy 2026-05-16 09:05:43 +08:00
• 18c16f8660 Port SGLANG_OPT_SWA_EVICT_DROP_PAGE_MARGIN from deepseek_v4_dev (#25419) Yuhao Yang 2026-05-16 08:39:13 +08:00
• d523ae127f Fix Mistral Large 3 nightly test (#25407) Brayden Zhongandb8zhong 2026-05-15 20:28:35 -04:00
• 5ba69f50fb Add multi-detokenizer support (#24944) 3 people 2026-05-16 08:26:26 +08:00
• afc7c9f7f3 [TRTLLM/SWA/Spec] fix trtllm mha + swa + spec accept length drop (#25103) Hanming Lu 2026-05-15 17:15:31 -07:00
• 3c2956d880 Add extension points on SpeculativeAlgorithm for custom spec v2 (#24999) jasonjk-park 2026-05-15 15:45:31 -07:00
• 7cb4669a04 [Fix] DeepSeek-V3.2: build structural tag locally to encode both wrapper and invoke layers (#25233) Xinyuan Tong 2026-05-15 22:32:50 +01:00
• 494ee71189 split test_dsa_models_mtp into 4 files (#25318) Liangsheng Yin 2026-05-15 14:16:57 -07:00
• f9caf43095 [CI] slash handler: lookup runs_on from runner_configs.yml (#25394) Liangsheng Yin 2026-05-15 13:59:00 -07:00
• 54221dd998 feat(moe): reuse prev-layer output as symm_output for FP4 routed MoE (#25379) Cheng WanandClaude Opus 4.7 2026-05-15 12:05:40 -07:00
• 33f1d3915f [NEW MODEL] Add H200 validation for Ring-2.6-1T cookbook (#25370) Xinyuan Tong 2026-05-15 19:47:15 +01:00
• 4df42da658 Introduce CudaDeviceMixin and CudaSRTPlatform (#24096) Alex Nails 2026-05-15 10:59:02 -07:00
• ee93795476 perf(mla): hybrid Triton fused cat+FP8-quantize for MLA chunked-prefill K/V (#25333) Cheng WanandClaude Opus 4.7 2026-05-15 10:51:00 -07:00
• 17c8a2fa53 [Llama4] Use strided in-place fused QK RMSNorm to drop a redundant copy (#25089) Kai-Hsun ChenandClaude Opus 4.7 2026-05-15 10:33:08 -07:00
• 21b3ac52b4 [UnifiedTree]: Fix UnifiedRadixCache device match semantics with HiCache (#25277) Zhangheng 2026-05-16 00:40:55 +08:00
• 3f7e538b2f Add NPU condition for cosine and sine caching (#25399) Cheng Wan 2026-05-15 05:21:53 -07:00
• fd9525436b move runs_on + rdma into runner_configs.yml (#25264) Liangsheng Yin 2026-05-15 04:19:13 -07:00
• 293027aafa pr-states: fix fork-PR token + add run-ci label awareness (#25392) Liangsheng Yin 2026-05-15 04:09:15 -07:00
• 3117415c9b ci: standalone PR awareness workflow (decouple from pr-test reusable chain) (#25387) Liangsheng Yin 2026-05-15 03:20:00 -07:00
• 20123e0b16 [diffusion] fix: mount Cache-DiT before torch.compile in native denoising (#25328) Chi McIsaac 2026-05-15 06:08:39 -04:00
• eec5ba26cf Fix incorrect import in test case (#25080) liuxianglong17 2026-05-15 17:35:57 +08:00
• eff736cc0f Deprecate /rerun-stage; scrub CUDA target_stage infra (#25322) Liangsheng Yin 2026-05-15 02:18:28 -07:00
• 1a1d69507d [Doc] Update MegaMoE usage (#25378) Baizhou Zhang 2026-05-15 02:17:50 -07:00
• fe7a5dd3bf [UnifiedTree]: Add nightly hicache ci for dsa model (#25348) Zhangheng 2026-05-15 16:54:50 +08:00
• 34cb8e2842 fix(sgl-kernel): sm90 compile flashmla failed (#24130) nohup 2026-05-15 16:42:33 +08:00
• 12408ec668 [Disagg] Add retry with exponential backoff for prefill bootstrap reg… (#25125) zhaochen zhang 2026-05-15 16:38:51 +08:00
• 0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335) 4 people 2026-05-15 01:04:56 -07:00
• 4adfc6cf7e ci: dispatch pr-test-extra.yml from pr-test.yml on the scheduled cron (#25320) 3 people 2026-05-15 01:01:23 -07:00
• 66ef97c00f [Lint] Fix Optional[X] = (None,) typo defaults in two dataclasses (#25252) shuwennandClaude Opus 4.7 2026-05-15 15:32:40 +08:00
• aaaad9e7c2 [Codex] Diffusion tune Hunyuan3D shape export chunks (#24358) Xiaoyu ZhangandBBuf Codex 2026-05-15 15:31:01 +08:00
• 9dad37f254 [AMD] Bump --timeout-per-file 1800->2400 for stage-b-test-1-gpu-small-amd (#25112) Michael 2026-05-15 15:10:04 +08:00
• c7e879e43f Add hicache feature in dsv4 cookbook (#25369) Zhangheng 2026-05-15 15:06:44 +08:00
• c3daa77e9a [NEW MODEL] Add Ring-2.6-1T cookbook (#25360) Xinyuan Tong 2026-05-15 07:32:22 +01:00
• 4b6b434dfe [diffusion] fix: fix Z-Image Cache-DiT sequence-parallel override (#25305) Chi McIsaac 2026-05-15 01:25:00 -04:00
• 6cfa4c9c2f [diffusion] fix: respect dit_precision config instead of hardcoded bfloat16 in DenoisingStagge (#24988) WenhaoZhangandniehen6174 2026-05-15 13:22:24 +08:00
• ad4994dc1d DeepseekV2MoE: defer shared experts when routed kernel is non-mutating (#25279) Cheng WanandClaude Opus 4.7 2026-05-14 22:20:55 -07:00
• 897587b03a [MUSA]: Add flashinfer sampling backend (#24978) 4 people 2026-05-15 11:23:15 +08:00
• d9fa84b25b [UnifiedTree]: Support HiCache For DeepSeek_V4 (#24691) 3 people 2026-05-15 11:20:52 +08:00
• 974948a701 fix: strip "[asctime]" prefix when parsing JSON log lines in nightly tests (#25340) Kangyan-Zhou 2026-05-14 20:17:13 -07:00
• d89b678d69 move dead sglang.test files to test/manual (#25316) Liangsheng Yin 2026-05-14 20:02:44 -07:00
• 8d5b347edd Support Qwen3.5 NVFP4 MTP DeepEP (#24906) YAMY 2026-05-14 19:49:14 -07:00
• 7af4320d67 [perf] fix kimi tokenizer to improve ttft (#25265) Qiaolin Yu 2026-05-14 19:11:25 -07:00
• dca9ba6321 perf(mla): TMA bulk-store set_mla_kv_buffer (up to 12× over baseline) (#25311) Cheng Wan 2026-05-14 18:23:41 -07:00
• 1913cb4dbb Skip CI tests added in #24816 (broken on main) (#25329) Cheng WanandClaude Opus 4.7 2026-05-14 18:12:13 -07:00
• 0fde61535f chore: bump sgl-kernel version to 0.4.2.post2 (#25326) sglang-botandsglang-bot 2026-05-14 17:53:17 -07:00
• 626fd61308 📝 docs: add canonical URL to fix Google indexing lmsysorg.mintlify.app instead of docs.sglang.io (#24935) Haoguang CaiandClaude Sonnet 4.6 2026-05-14 16:46:40 -07:00
• ba214ef3d3 ci: tag-gated nightly migration — foundation + 40 whole-file moves (#24725) 3 people 2026-05-14 16:11:15 -07:00
• 67096f48bf Revert "[MoE] Decouple Mega MoE from DeepEP backend" (#25317) Liangsheng Yin 2026-05-14 16:00:41 -07:00
• 78408d2300 Fix frozen kv MTP crash when bonus_tokens is None (#25204) Charles Chen 2026-05-14 15:33:55 -07:00
• 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) Liangsheng Yin 2026-05-14 15:28:58 -07:00
• 88d3ed7df1 Enable SGLANG_OPT_FP8_WO_A_GEMM by default (#25181) Yuhao Yang 2026-05-15 02:09:13 +08:00
• 37f030a0de [MoE] Decouple Mega MoE from DeepEP backend (#24884) Yuhao Yang 2026-05-15 02:01:44 +08:00
• 3fc60e5748 [MLX] bench_one_batch: thread --quantization through to MlxModelRunner (#25221) Le ZhangandClaude Opus 4.7 2026-05-14 09:56:42 -07:00
• 90afd680f3 [Apple Silicon] [MLX] Auto-detect MLX-format quantization_config dict (#25191) Jae B. 2026-05-14 12:55:37 -04:00
• 50f405816e ci: add Jialin to CI permissions (custom override) (#25234) Jialin Ouyang 2026-05-14 02:54:07 -07:00
• 4593bbdf31 ci: dynamic partition + LPT from live sglang-ci-stats model (#25263) Liangsheng Yin 2026-05-14 02:35:59 -07:00
• 373a22c225 [NPU] [DOC] fix issues in ascend npu docs (#25268) amote-i 2026-05-14 17:25:47 +08:00
• 2279b79f35 Add --model-config-parser registry for pluggable config formats (#25050) Xingyu Liu 2026-05-14 01:54:06 -07:00
• 4be25f2428 fix(disagg): broadcast bootstrap port across multi-node prefill ranks (#24378) YAMY 2026-05-14 01:39:01 -07:00
• 2417a9da57 [CI] Bundle check-changes outputs + caller inputs into 2 JSON inputs (#25238) Liangsheng Yin 2026-05-14 01:02:01 -07:00
• d311f311bc ci: read est_time from sglang-ci-stats instead of scraping CI logs (#25255) Liangsheng Yin 2026-05-14 00:36:25 -07:00
• bc265c5f82 [AMD] Add amd jit resolve token ids bench ci (#25210) 3 people 2026-05-14 15:13:12 +08:00
• 7b128e143a [AMD] Add amd jit clamp position bench ci (#25209) 3 people 2026-05-14 15:03:56 +08:00
• 41eb2d861b [fix] load_audio: fall back to soundfile when torchcodec fails on WAV with trailing metadata (#24185) Yihao Wang 2026-05-14 00:02:49 -07:00
• 22bfae0d1d [AMD] Auto-fallback NSA indexer to page_size=1 when aiter preshuffle gluon kernel is unavailable (Deepseek v3.2) (#25205) YC Yen-Ching Tseng 2026-05-14 15:01:56 +08:00
• 142ed710b7 [CI] Support new-style register_cuda_ci(stage=, runner_config=) in slash handler + est-time updater (#25248) Liangsheng Yin 2026-05-13 23:53:49 -07:00
• 421179c453 [perf] avoid hidden states d2h when return_hidden_states=false (#25155) Qiaolin Yu 2026-05-13 23:47:17 -07:00
• 1f119f6a44 [Docs] update dsv4 cookbook with H100 deployment commands (#25243) zijiexiaandClaude Opus 4.7 2026-05-13 23:45:29 -07:00
• 0680f1b3d1 Add IntraNode NVLink configration in PD disaggregation docs (#23329) Lewisand百麒 2026-05-14 14:23:57 +08:00
• 3640116397 [NPU]Bugfix:Set default values for npu_wrapper_preprocess parameters (#25130) AndyLi429 2026-05-14 14:21:11 +08:00
• be156d6804 [HiCache] enable ssd offload support for mooncake store (#24277) 4 people 2026-05-14 14:07:02 +08:00
• 36c9495aaa ci: H200 conditional split + dsv4 est_time recalibration (h200 partition 6→2) (#25236) Alison Shao 2026-05-13 22:28:37 -07:00
• e4378ff37f [UnifiedRadixCache] Fix HiCache load back start node (#25088) Ke Bao 2026-05-14 13:18:12 +08:00
• c016246b0f [Rerank] Early-exit logprob scan and hoist math import (#25046) Tejas Dharamsi 2026-05-13 22:01:07 -07:00
• a6a6c3119b LFM2: pass has_initial_state to causal_conv1d_fn for prefill (#24717) Piotr MazurekandPiotr Mazurek 2026-05-14 06:57:58 +02:00
• 5c11c2492f ci: emit machine-readable TIMINGS block at end of run_unittest_files (#25232) Liangsheng Yin 2026-05-13 21:56:54 -07:00
• 85d9c77c57 ci: extract cuda stage actions + runner_config mapping (#25138) Liangsheng YinandAlison Shao 2026-05-13 21:16:57 -07:00
• fd889097dc [Bug Fix] Add priority property to DecodeRequest to fix AttributeError with --enable-priority-scheduling (#25064) Pai Liu 2026-05-14 13:54:25 +10:00
• edb1b3f8f5 [NPU] add Ascend NPU Accuracy Evaluation and Faq docs (#24777) jianzhao-xu 2026-05-14 11:28:16 +08:00
• f7efff321d [Docker] Fix several dependencies in Dockerfile (#25215) Baizhou Zhang 2026-05-13 20:18:26 -07:00
• b71d74673c ci: combine H200 8-GPU warmup steps and surface server log on every path (#24253) Alison Shao 2026-05-13 20:09:52 -07:00
• 8b9ff4a68c [SMG] Expand K8s integration tests: cross-namespace, lifecycle, multi-model (#24375) Kangyan-ZhouandClaude Opus 4.7 2026-05-13 20:08:09 -07:00
• e8d57e7243 [SMG] Fix cache-aware policy pool isolation in PD mode (#25184) Kangyan-ZhouandClaude Opus 4.7 2026-05-13 20:07:14 -07:00
• e51bde1e9f fix: prefix matching against matrix-expanded job names (#25212) Liangsheng Yin 2026-05-13 20:02:57 -07:00
• 856f13a916 chore(codeowners): add kpham-sgl to frozen_kv_mtp files (#25211) Khoa PhamandClaude Opus 4.7 2026-05-13 20:01:05 -07:00
• c701a08765 feat: [2/2][DeepEP] Add waterfill load balancing for shared expert dispatch (#19290) 4 people 2026-05-14 10:23:41 +08:00
• 426dd339da Migrate Intel CPU cases to the test/registered (#25139) jundu 2026-05-14 10:22:09 +08:00
• 65e9f81c7d [NPU] [DOC] add performance testing and optimization docs for npu (#25114) amote-i 2026-05-14 09:47:55 +08:00
• 992fc0d6fe ci(sgl-kernel-build): actually reclaim disk in the wheel-build cleanup step (#25206) Kangyan-ZhouandClaude 2026-05-13 18:45:48 -07:00
• 1e308aec66 ci: B200 conditional split + LPT_SLOP removal (stage-c partition 8→3) (#25203) Alison Shao 2026-05-13 18:40:45 -07:00
• 5fb6bde6c0 Add sglang:get_loads_duration_seconds metric (#25163) Lianmin Zhengandcctry 2026-05-13 18:38:49 -07:00