minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
12,628 Commits 2 Branches 0 Tags
36c9495aaaf784225ab6c02f1828866e4474e684
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Alison Shao 36c9495aaa ci: H200 conditional split + dsv4 est_time recalibration (h200 partition 6→2) (#25236) 2026-05-13 22:28:37 -07:00
Alison Shao b71d74673c ci: combine H200 8-GPU warmup steps and surface server log on every path (#24253) 2026-05-13 20:09:52 -07:00
Alison Shao 1e308aec66 ci: B200 conditional split + LPT_SLOP removal (stage-c partition 8→3) (#25203) 2026-05-13 18:40:45 -07:00
Alison Shao dd98153d17 chore(ci_monitor): drop post_bisect_to_slack (#25192) 2026-05-13 17:05:38 -07:00
Alison Shao 1419bcc39e [CI] Temporarily disable multimodal-gen test_update_weights_from_disk (flaky) (#25032) 2026-05-12 12:28:33 -07:00
Alison Shao 5fbec0e445 ci: prune per-commit CUDA tests — move 25 files + 13 testcases to test/manual/ (#24721) 2026-05-08 15:53:23 -07:00
Alison Shao aefd8e257f Re-land #23109: rebase-required mode + fix for grep-no-match abort (#24180) 2026-05-08 15:28:57 -07:00
Alison Shao e72246c6e6 ci: bump test_mimo_models.py est_time 330 → 610 (#24551) 2026-05-06 14:35:43 -07:00
Alison Shao 094b90b1ec ci: drop 1-gpu-h100-h200 shared label (#24495) 2026-05-06 01:02:31 -07:00
Alison Shao f3dbadb82b fix: accept 0-indexed safetensors shard names in CI weight validator (#24237) 2026-05-02 00:58:15 -07:00
Alison Shao 357e3789ea ci: limit nightly test parallelism to 1 job per hardware type (#23314) 2026-04-30 21:49:18 -07:00
Alison Shao 918f910cf0 ci: temporarily disable multimodal-gen-test-1-b200 (#24174) 2026-04-30 16:16:43 -07:00
Alison ShaoandAlison Shao 694ef516cb Revert "[ci] split stage-c-test-4-gpu-b200 to enable a low-disk runner pool" (#24163) 
Co-authored-by: Alison Shao <alisonshao@radixark.ai>
 2026-04-30 15:57:19 -07:00
Alison ShaoandAlison Shao cdc4078815 ci: add rebase-required mode to check-maintenance action (#23109) 
Co-authored-by: Alison Shao <alisonshao@radixark.ai>
 2026-04-30 15:47:24 -07:00
Alison Shao dc395bc059 ci: run setup_ld_library_path before install_sglang_kernel (#24141) 2026-04-30 10:55:45 -07:00
Alison Shao 7bb7f6049a ci: add per-host utilization view to runner-utilization report (#24102) 2026-04-30 10:05:16 -07:00
Alison Shao b73c44b545 test: relax TestMLADeepseekV3.test_gsm8k threshold 0.62 -> 0.60 (#23879) 2026-04-27 15:27:15 -07:00
Alison Shao 267c2c0849 test: move test_epd_disaggregation to nightly-4-gpu (#23518) 2026-04-22 20:59:19 -07:00
Alison Shao 04b1caf75b ci: enable /rerun-test for multimodal gen PR tests (#22828) 2026-04-21 21:34:14 -07:00
Alison Shao 0e165ffbfc ci: enable /rerun-test for nightly test suites (#22830) 2026-04-21 18:28:10 -07:00
Alison Shao 6b19e8a452 ci: reduce scheduled PR test from 4x to 3x daily (#23313) 2026-04-20 20:53:13 -07:00
Alison Shao 0052093178 test(4-gpu-b200): split test_qwen35_models.py + bump partitions 5→6 (#22913) 2026-04-16 18:51:59 -07:00
Alison Shao 3f4fbc165d Upgrade CI default CUDA version from 12.9 to 13.0 (#21441) 2026-04-12 21:48:40 -07:00
Alison ShaoandAlison Shao d6c9d9116b [CI] Update B200 est_times to prevent timeouts on slower machine (#22609) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-11 21:40:34 -07:00
Alison ShaoandAlison Shao f21d23a211 ci: use local NVIDIA wheels to avoid re-downloading ~2GB every CI run (#22602) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-11 21:32:51 -07:00
Alison ShaoandAlison Shao 870a21bf39 [CI] Remove Slack bot from CI failure monitor (#21581) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-11 20:34:48 -07:00
Alison ShaoandAlison Shao 75223c5404 [Diffusion][CI] Fix nunchaku unit test broken by #22365 (#22560) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-10 17:49:56 -07:00
Alison ShaoandAlison Shao b853e2c41b [CI] Remove Slack notification from ci-auto-bisect workflow (#22483) 
Co-authored-by: Alison Shao <alison.shao@Mac.lan>
 2026-04-09 20:32:09 -07:00
Alison ShaoAlison ShaoAlison Shao
 		45b0182205 [CI] Update est_time for 64 tests based on actual elapsed times (#22305) 
Co-authored-by: Alison Shao <alison.shao@Mac.lan>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-09 20:31:37 -07:00
Alison ShaoandAlison Shao cf27b11498 [CI] Increase stage-c-test-4-gpu-b200 partitions from 4 to 5 (#22395) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-08 16:36:27 -07:00
Alison ShaoandAlison Shao 614dd1d4f5 [CI] Add alexnails to CI_PERMISSIONS.json (#22391) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-08 16:22:05 -07:00
Alison ShaoAlison ShaoAlison Shao
 		e41647f52b [CI] Add pre-commit hook to validate test/registered/ files have CI registry (#22308) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-08 15:59:15 -07:00
Alison ShaoandAlison Shao 2ad5e6df12 [CI] Relax gpt-oss 4GPU accuracy threshold from 0.60 to 0.58 (#22237) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-08 02:20:23 -07:00
Alison ShaoandAlison Shao 36f05810c9 [CI] Move manual-only nightly tests out of test/registered/ (#22298) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-07 21:03:52 -07:00
Alison ShaoandAlison Shao 86e4542f35 Use dedicated runner label for deepep 8-GPU tests (#22309) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-07 19:58:54 -07:00
Alison ShaoandAlison Shao 6f1412f4f5 [CI] Relax transformers MMLU threshold from 0.65 to 0.64 (#22210) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-06 15:32:09 -07:00
Alison ShaoandAlison Shao 1ac74e652e [Misc] Fix comparator e2e tests: add polars dep + fix dp-attention test (#21804) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
 2026-04-01 15:44:35 -07:00
Alison ShaoandAlison Shao 9b6bee2d40 Fix human-eval CI install on 5090 runners (#21714) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-03-30 18:53:09 -07:00
Alison ShaoandAlison Shao 3650bfb199 Remove flashinfer wheel cache cleanup that deletes other versions (#21711) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-03-30 16:47:04 -07:00
Alison ShaoAlison ShaoAlison Shaohnyls2002Liangsheng Yin
 		5297a3cb46 [CI] Rewrite killall_sglang as Python with CI/local dual mode (#21331) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-03-24 23:54:01 -07:00
Alison ShaoAlison Shaohnyls2002
 		17e41cfb21 Fix RDMA device mapping for non-zero GPU indices in disaggregation tests (#21303) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-24 22:56:57 -07:00
Alison ShaoandAlison Shao 44db0c59cf [CI] Fix cutlass import error: restore nvidia-cutlass-dsl force-reinstall (#21182) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
 2026-03-22 22:41:01 -07:00
Alison ShaoandAlison Shao 852e112ebf [Qwen3.5] Fix broken pipeline parallelism layer splitting (#21070) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-03-21 01:02:51 -07:00
Alison ShaoandAlison Shao b7a1ae4fac Fix /rerun-stage dispatch failure for non-AMD stages (#21076) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-03-20 23:48:29 -07:00
Alison Shao 048d90e165 Revert "[AMD] Add MoE weights and scales padding" (#21067) 2026-03-20 20:26:17 -07:00
Alison ShaoandAlison Shao 7b44bc923e Relax flaky B200 GSM8K accuracy thresholds (#20304) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-11 12:35:21 -07:00
Alison ShaoandAlison Shao eea7f8de41 [CI] Fix B200 runner label for scheduled runs (#20297) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-10 16:00:31 -07:00
Alison ShaoandAlison Shao f32882cee5 [CI] Relax Eagle infer_b spec accept length threshold (#20300) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-10 15:40:52 -07:00
Alison ShaoandAlison Shao 0f62da6953 [CI] Show test partition assignments after checkout (#20085) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-07 13:50:49 -08:00
Alison ShaoandAlison Shao 1aa6ab41de [Nightly] Replace MiniMax-M2 with MiniMax-M2.5 (#20083) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-07 01:15:34 -08:00
Alison ShaoandAlison Shao 011806c419 [Nightly] Add Kimi K2.5 nightly test (base + Eagle3 MTP), replace Kimi K2 (#19802) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 23:44:04 -08:00
Alison ShaoandAlison Shao c584158135 [CI] Temporarily disable flaky test_priority_metrics on CUDA (#20075) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 20:34:45 -08:00
Alison ShaoandAlison Shao 50bbdcf8e9 Relax flaky test thresholds for MLA DeepSeek V3 and AutoRound (#20068) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 17:26:28 -08:00
Alison ShaoAlison ShaoAlison Shao
 		ac453b253f Add Qwen3.5-397B-A17B nightly test (8-GPU) (#19906) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 13:49:28 -08:00
Alison ShaoAlison ShaoAlison ShaoAlison Shao
 		1c1712d8e5 [CI] Skip flashinfer-cubin reinstall when version matches (#19470) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-05 13:30:44 -08:00
Alison ShaoandAlison Shao eb6bcc5c86 [CI] Register test_quant_config_parsing.py in CI suite (#19809) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-03 16:53:31 -08:00
Alison ShaoandAlison Shao c18cff4f90 [CI] Add DeepGEMM warmup to stage-c-test-deepep-4-gpu (#19806) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-03 16:18:12 -08:00
Alison ShaoandAlison Shao fe9d85d93c Fix CompressedTensorsMxInt4MoE abstract method and relax GPQA baseline (#19726) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-02 19:03:21 -08:00
Alison ShaoandAlison Shao a45613f2a6 Revert "[SGL] sync patch: Remove sync points, prefill cudagraph for DP, disable cache reset in mem check (#19190)" (#19581) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-02-28 19:46:47 -08:00
Alison ShaoandAlison Shao 2bd2b60b5c [CI] Disable test_lora_update: Nutanix LoRA adapter removed from HuggingFace (#19527) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 15:38:19 -08:00
Alison ShaoandAlison Shao 6ca7da3e7c Fix nightly VLM accuracy: gemma3n TP fixes + removal, latency thresholds (#19401) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 14:24:02 -08:00
Alison ShaoandAlison Shao 2c856c6d27 Allow PR authors to use /rerun-failed-ci on their own PRs (#19496) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 10:14:57 -08:00
Alison ShaoandAlison Shao 52c8a3632a Fix missing StandardCombineInput import in BF16 flashinfer_trtllm MoE (#19400) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 18:32:08 -08:00
Alison ShaoAlison ShaoAlison Shao
 		c2dce06d9f Fix parallel tool call test for speculative decoding variants (#19370) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 18:31:20 -08:00
Alison ShaoandAlison Shao e14fd4accb Fix nightly Mistral-Large-3 NVFP4 accuracy threshold (#19402) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 15:59:11 +08:00
Alison Shao 0fd44ff342 Fix NSA CP positions mismatch in eagle NextN model (#19367) 2026-02-25 20:14:33 -08:00
Alison ShaoAlison Shaosglang-bot
 		a0a8f1473c [Benchmark] Fix generated_shared_prefix attribute naming and remove args dependency (#19363) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2026-02-25 18:45:54 -08:00
Alison Shao cc1ca61c81 fix: add --cuda-graph-max-bs to DSV3 FA3 FP8 KV cache test (#19307) 2026-02-25 10:27:31 -08:00
Alison Shao f862214c67 ci: temporarily disable GB200 test stage (#19289) 2026-02-24 19:04:23 -08:00
Alison Shao 750ecf4a45 Add server CUDA graph warmup CI step for cold H200 nodes (#19201) 2026-02-24 16:07:01 -08:00
Alison Shao e2fccb2ee0 Fix flaky Qwen3-Next KL divergence tests by reverting mamba slot release (#18910) 2026-02-19 07:55:16 +08:00
Alison Shao 34d975b18f Fix eval tests not capturing server launch failures (#18886) 2026-02-18 07:59:03 +08:00
Alison Shao 7e41ac6c8d Skip flaky test_tool_choice_required_non_streaming for Mistral (#18889) 2026-02-17 12:50:55 +08:00
Alison ShaoandLiangsheng Yin f9c3def7fe Fix CI: add flashinfer --download-cubin to install dependencies (#18887) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-02-16 13:50:10 -08:00
Alison Shao 206accd15d Fix GLM-4V processor registration when glm_ocr is unavailable (#18885) 2026-02-16 16:02:31 +08:00
Alison Shao 86c181e335 Fix test_lora_qwen3 nightly failure: replace adapter with added_tokens (#18884) 2026-02-16 14:35:06 +08:00
Alison Shao f7603203b0 Enable DeepGemm fast warmup in CI to prevent cold-cache timeouts (#18823) 2026-02-16 00:02:30 +08:00
Alison Shao 8ef3e3d56b Fix CI concurrency collision between scheduled runs and fork PRs (#18826) 2026-02-14 10:48:31 +08:00
Alison Shao dd77bd4651 Fix invalid import paths in glm_image.py (#18757) 2026-02-12 16:44:34 -08:00
Alison ShaoandLiangsheng Yin 0abe4a22c6 Fix flaky penalty tests by using higher temperature for effect comparison (#18380) 
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-02-12 21:08:37 +08:00
Alison Shao f20b1703ce [CI] Fix torchaudio/torchvision CUDA version mismatch (#18211) 2026-02-11 23:47:32 -08:00
Alison Shao 7eaf866846 [CI] Install python3-dev for Triton JIT compilation on fresh runners (#18644) 2026-02-11 16:28:57 -08:00
Alison Shao dcc63dc545 [CI] Guard python3 call in install script for fresh runners (#18609) 2026-02-12 00:05:29 +08:00
Alison Shao bedade1ef0 Merge stage-c-test-large-4-gpu suites into partitioned suites (#18325) 2026-02-06 15:32:33 -08:00
Alison Shao d0c39bc219 Fix cross-container HF download race condition in CI (#18328) 2026-02-05 21:01:41 -08:00
Alison Shao d22163eb8c Fix flaky test_frequency_penalty_reduces_word_repetition by using deterministic seeds (#18285) 2026-02-05 10:24:18 -08:00
Alison Shao c910829708 Fix test_return_routed_experts to use response-level sglext (#18274) 2026-02-04 20:16:01 -08:00
Alison ShaoandKangyan-Zhou 28e2340725 Fix HF hub race condition in CI by coordinating model downloads across TP ranks (#17787) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-02-02 14:57:45 -08:00
Alison Shao 812fd47cb4 Re-enable test_mla_int8_deepseek_v3.py after HF token fix (#18123) 2026-02-02 14:38:42 -08:00
Alison Shao 56907cbcb1 Move deleted 8-GPU tests to test/manual/ (#18060) 2026-02-01 00:21:56 -08:00
Alison Shao a0bae4c343 Migrate 4-GPU/8-GPU workflow jobs to stage-c and add CI registry decorators (#17299) 2026-01-31 22:37:22 -08:00
Alison Shao 95180484e9 Disable test_mla_int8_deepseek_v3.py temporarily (#18057) 2026-01-31 22:33:43 -08:00
Alison Shao 1f75c2af4d Fix /tag-and-rerun-ci to do full rerun when PR has sgl-kernel changes (#17729) 2026-01-29 12:54:30 -08:00
Alison Shao 6c0f9b4824 Add test_gpt_oss_4gpu.py to B200 test suite (#17743) 2026-01-26 21:57:06 +08:00
Alison Shao 30b3192039 Merge performance/accuracy test suites into regular stage-b suites (#17609) 2026-01-25 22:49:19 -08:00
Alison Shao 7b22b8ff8a Fix sgl-kernel install: fail instead of PyPI fallback when artifacts missing (#17728) 2026-01-26 11:46:49 +08:00
Alison Shao 9121f22656 Add PyTorch .bin file validation to CI weight validation (#17533) 2026-01-24 19:18:15 -08:00
Alison Shao b23470e95a Fix CI install failure when rerunning tests via workflow_dispatch (#17612) 2026-01-23 00:04:16 -08:00
Alison Shao d7dd0b8832 Re-enable unit-test-deepep-8-gpu and unit-test-backend-4-gpu-gb200 (#17438) 2026-01-23 14:31:44 +08:00
Alison Shao 1e8e0cca2c Update test README with CI registry documentation and 5090/H100 guidance (#17368) 2026-01-22 16:29:08 -08:00