minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
11,393 Commits 2 Branches 0 Tags
36f05810c9c7fc5fe63736439378aa6233856222
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Alison ShaoandAlison Shao 36f05810c9 [CI] Move manual-only nightly tests out of test/registered/ (#22298) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-07 21:03:52 -07:00
Alison ShaoandAlison Shao 86e4542f35 Use dedicated runner label for deepep 8-GPU tests (#22309) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-07 19:58:54 -07:00
Alison ShaoandAlison Shao 6f1412f4f5 [CI] Relax transformers MMLU threshold from 0.65 to 0.64 (#22210) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-06 15:32:09 -07:00
Alison ShaoandAlison Shao 1ac74e652e [Misc] Fix comparator e2e tests: add polars dep + fix dp-attention test (#21804) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
 2026-04-01 15:44:35 -07:00
Alison ShaoandAlison Shao 9b6bee2d40 Fix human-eval CI install on 5090 runners (#21714) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-03-30 18:53:09 -07:00
Alison ShaoandAlison Shao 3650bfb199 Remove flashinfer wheel cache cleanup that deletes other versions (#21711) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-03-30 16:47:04 -07:00
Alison ShaoAlison ShaoAlison Shaohnyls2002Liangsheng Yin
 		5297a3cb46 [CI] Rewrite killall_sglang as Python with CI/local dual mode (#21331) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-03-24 23:54:01 -07:00
Alison ShaoAlison Shaohnyls2002
 		17e41cfb21 Fix RDMA device mapping for non-zero GPU indices in disaggregation tests (#21303) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-24 22:56:57 -07:00
Alison ShaoandAlison Shao 44db0c59cf [CI] Fix cutlass import error: restore nvidia-cutlass-dsl force-reinstall (#21182) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
 2026-03-22 22:41:01 -07:00
Alison ShaoandAlison Shao 852e112ebf [Qwen3.5] Fix broken pipeline parallelism layer splitting (#21070) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-03-21 01:02:51 -07:00
Alison ShaoandAlison Shao b7a1ae4fac Fix /rerun-stage dispatch failure for non-AMD stages (#21076) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-03-20 23:48:29 -07:00
Alison Shao 048d90e165 Revert "[AMD] Add MoE weights and scales padding" (#21067) 2026-03-20 20:26:17 -07:00
Alison ShaoandAlison Shao 7b44bc923e Relax flaky B200 GSM8K accuracy thresholds (#20304) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-11 12:35:21 -07:00
Alison ShaoandAlison Shao eea7f8de41 [CI] Fix B200 runner label for scheduled runs (#20297) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-10 16:00:31 -07:00
Alison ShaoandAlison Shao f32882cee5 [CI] Relax Eagle infer_b spec accept length threshold (#20300) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-10 15:40:52 -07:00
Alison ShaoandAlison Shao 0f62da6953 [CI] Show test partition assignments after checkout (#20085) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-07 13:50:49 -08:00
Alison ShaoandAlison Shao 1aa6ab41de [Nightly] Replace MiniMax-M2 with MiniMax-M2.5 (#20083) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-07 01:15:34 -08:00
Alison ShaoandAlison Shao 011806c419 [Nightly] Add Kimi K2.5 nightly test (base + Eagle3 MTP), replace Kimi K2 (#19802) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 23:44:04 -08:00
Alison ShaoandAlison Shao c584158135 [CI] Temporarily disable flaky test_priority_metrics on CUDA (#20075) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 20:34:45 -08:00
Alison ShaoandAlison Shao 50bbdcf8e9 Relax flaky test thresholds for MLA DeepSeek V3 and AutoRound (#20068) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 17:26:28 -08:00
Alison ShaoAlison ShaoAlison Shao
 		ac453b253f Add Qwen3.5-397B-A17B nightly test (8-GPU) (#19906) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 13:49:28 -08:00
Alison ShaoAlison ShaoAlison ShaoAlison Shao
 		1c1712d8e5 [CI] Skip flashinfer-cubin reinstall when version matches (#19470) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-05 13:30:44 -08:00
Alison ShaoandAlison Shao eb6bcc5c86 [CI] Register test_quant_config_parsing.py in CI suite (#19809) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-03 16:53:31 -08:00
Alison ShaoandAlison Shao c18cff4f90 [CI] Add DeepGEMM warmup to stage-c-test-deepep-4-gpu (#19806) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-03 16:18:12 -08:00
Alison ShaoandAlison Shao fe9d85d93c Fix CompressedTensorsMxInt4MoE abstract method and relax GPQA baseline (#19726) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-02 19:03:21 -08:00
Alison ShaoandAlison Shao a45613f2a6 Revert "[SGL] sync patch: Remove sync points, prefill cudagraph for DP, disable cache reset in mem check (#19190)" (#19581) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-02-28 19:46:47 -08:00
Alison ShaoandAlison Shao 2bd2b60b5c [CI] Disable test_lora_update: Nutanix LoRA adapter removed from HuggingFace (#19527) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 15:38:19 -08:00
Alison ShaoandAlison Shao 6ca7da3e7c Fix nightly VLM accuracy: gemma3n TP fixes + removal, latency thresholds (#19401) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 14:24:02 -08:00
Alison ShaoandAlison Shao 2c856c6d27 Allow PR authors to use /rerun-failed-ci on their own PRs (#19496) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 10:14:57 -08:00
Alison ShaoandAlison Shao 52c8a3632a Fix missing StandardCombineInput import in BF16 flashinfer_trtllm MoE (#19400) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 18:32:08 -08:00
Alison ShaoAlison ShaoAlison Shao
 		c2dce06d9f Fix parallel tool call test for speculative decoding variants (#19370) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 18:31:20 -08:00
Alison ShaoandAlison Shao e14fd4accb Fix nightly Mistral-Large-3 NVFP4 accuracy threshold (#19402) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 15:59:11 +08:00
Alison Shao 0fd44ff342 Fix NSA CP positions mismatch in eagle NextN model (#19367) 2026-02-25 20:14:33 -08:00
Alison ShaoAlison Shaosglang-bot
 		a0a8f1473c [Benchmark] Fix generated_shared_prefix attribute naming and remove args dependency (#19363) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2026-02-25 18:45:54 -08:00
Alison Shao cc1ca61c81 fix: add --cuda-graph-max-bs to DSV3 FA3 FP8 KV cache test (#19307) 2026-02-25 10:27:31 -08:00
Alison Shao f862214c67 ci: temporarily disable GB200 test stage (#19289) 2026-02-24 19:04:23 -08:00
Alison Shao 750ecf4a45 Add server CUDA graph warmup CI step for cold H200 nodes (#19201) 2026-02-24 16:07:01 -08:00
Alison Shao e2fccb2ee0 Fix flaky Qwen3-Next KL divergence tests by reverting mamba slot release (#18910) 2026-02-19 07:55:16 +08:00
Alison Shao 34d975b18f Fix eval tests not capturing server launch failures (#18886) 2026-02-18 07:59:03 +08:00
Alison Shao 7e41ac6c8d Skip flaky test_tool_choice_required_non_streaming for Mistral (#18889) 2026-02-17 12:50:55 +08:00
Alison ShaoandLiangsheng Yin f9c3def7fe Fix CI: add flashinfer --download-cubin to install dependencies (#18887) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-02-16 13:50:10 -08:00
Alison Shao 206accd15d Fix GLM-4V processor registration when glm_ocr is unavailable (#18885) 2026-02-16 16:02:31 +08:00
Alison Shao 86c181e335 Fix test_lora_qwen3 nightly failure: replace adapter with added_tokens (#18884) 2026-02-16 14:35:06 +08:00
Alison Shao f7603203b0 Enable DeepGemm fast warmup in CI to prevent cold-cache timeouts (#18823) 2026-02-16 00:02:30 +08:00
Alison Shao 8ef3e3d56b Fix CI concurrency collision between scheduled runs and fork PRs (#18826) 2026-02-14 10:48:31 +08:00
Alison Shao dd77bd4651 Fix invalid import paths in glm_image.py (#18757) 2026-02-12 16:44:34 -08:00
Alison ShaoandLiangsheng Yin 0abe4a22c6 Fix flaky penalty tests by using higher temperature for effect comparison (#18380) 
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-02-12 21:08:37 +08:00
Alison Shao f20b1703ce [CI] Fix torchaudio/torchvision CUDA version mismatch (#18211) 2026-02-11 23:47:32 -08:00
Alison Shao 7eaf866846 [CI] Install python3-dev for Triton JIT compilation on fresh runners (#18644) 2026-02-11 16:28:57 -08:00
Alison Shao dcc63dc545 [CI] Guard python3 call in install script for fresh runners (#18609) 2026-02-12 00:05:29 +08:00
Alison Shao bedade1ef0 Merge stage-c-test-large-4-gpu suites into partitioned suites (#18325) 2026-02-06 15:32:33 -08:00
Alison Shao d0c39bc219 Fix cross-container HF download race condition in CI (#18328) 2026-02-05 21:01:41 -08:00
Alison Shao d22163eb8c Fix flaky test_frequency_penalty_reduces_word_repetition by using deterministic seeds (#18285) 2026-02-05 10:24:18 -08:00
Alison Shao c910829708 Fix test_return_routed_experts to use response-level sglext (#18274) 2026-02-04 20:16:01 -08:00
Alison ShaoandKangyan-Zhou 28e2340725 Fix HF hub race condition in CI by coordinating model downloads across TP ranks (#17787) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-02-02 14:57:45 -08:00
Alison Shao 812fd47cb4 Re-enable test_mla_int8_deepseek_v3.py after HF token fix (#18123) 2026-02-02 14:38:42 -08:00
Alison Shao 56907cbcb1 Move deleted 8-GPU tests to test/manual/ (#18060) 2026-02-01 00:21:56 -08:00
Alison Shao a0bae4c343 Migrate 4-GPU/8-GPU workflow jobs to stage-c and add CI registry decorators (#17299) 2026-01-31 22:37:22 -08:00
Alison Shao 95180484e9 Disable test_mla_int8_deepseek_v3.py temporarily (#18057) 2026-01-31 22:33:43 -08:00
Alison Shao 1f75c2af4d Fix /tag-and-rerun-ci to do full rerun when PR has sgl-kernel changes (#17729) 2026-01-29 12:54:30 -08:00
Alison Shao 6c0f9b4824 Add test_gpt_oss_4gpu.py to B200 test suite (#17743) 2026-01-26 21:57:06 +08:00
Alison Shao 30b3192039 Merge performance/accuracy test suites into regular stage-b suites (#17609) 2026-01-25 22:49:19 -08:00
Alison Shao 7b22b8ff8a Fix sgl-kernel install: fail instead of PyPI fallback when artifacts missing (#17728) 2026-01-26 11:46:49 +08:00
Alison Shao 9121f22656 Add PyTorch .bin file validation to CI weight validation (#17533) 2026-01-24 19:18:15 -08:00
Alison Shao b23470e95a Fix CI install failure when rerunning tests via workflow_dispatch (#17612) 2026-01-23 00:04:16 -08:00
Alison Shao d7dd0b8832 Re-enable unit-test-deepep-8-gpu and unit-test-backend-4-gpu-gb200 (#17438) 2026-01-23 14:31:44 +08:00
Alison Shao 1e8e0cca2c Update test README with CI registry documentation and 5090/H100 guidance (#17368) 2026-01-22 16:29:08 -08:00
Alison Shao e6ccb2949b Increase wait-for-stage timeouts to handle long queue times (#17536) 2026-01-21 16:10:52 -08:00
Alison Shao d6ea2c529c Fix import path for UnquantizedLinearMethod in test (#17529) 2026-01-21 15:34:02 -08:00
Alison Shao 9be2a3a9a3 Remove test_gpt_oss_4gpu.py from __not_in_ci__ (keep in per-commit-4-gpu) (#17534) 2026-01-21 15:31:03 -08:00
Alison Shao 85d9af51da Temporarily disable flaky test_gpt_oss_4gpu.py on B200 (#17528) 2026-01-21 14:01:04 -08:00
Alison Shao 0050c476fd Add job-level timeout for weekly test workflow (#17462) 2026-01-20 22:45:39 -08:00
Alison Shao 3321eb4efa Fix pr-test-finish to fail when wait-for-stage jobs fail (#17465) 2026-01-20 20:50:27 -08:00
Alison Shao 823a046e8f Add hybrid parallelism test to nightly CI (#17444) 2026-01-20 17:43:50 -08:00
Alison Shao 648aab0ce3 Fix wait-for-stage jobs running when call-gate fails (#17443) 2026-01-20 17:40:05 -08:00
Alison Shao 17c04b109d Enable parallel stage execution for scheduled CI runs (#16880) 2026-01-19 18:31:46 -08:00
Alison Shao 55c4288b3e Fix runner utilization workflow to use 24h default (#17378) 2026-01-19 18:31:33 -08:00
Alison Shao 7e40d52635 Move test_autoround.py to stage-b-test-large-1-gpu suite (#17336) 2026-01-19 14:36:19 -08:00
Alison Shao 057b07fc50 Disable unit-test-backend-4-gpu-gb200 job (#17367) 2026-01-19 14:35:58 -08:00
Alison ShaoandKangyan-Zhou 8916b9d080 Migrate performance, accuracy, and quantization tests to CI registry (#17177) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-01-18 23:25:24 -08:00
Alison Shao fb88fb672e fix(ci): rate limit and permission errors in trace publishing (#17238) 2026-01-18 23:20:22 -08:00
Alison Shao 2d72e168fd [CI] Add partition to stage-b-test-large-1-gpu (11->12) (#17245) 2026-01-18 23:19:39 -08:00
Alison Shao 7edb06158e Add runner utilization report workflow (#17234) 2026-01-17 19:28:05 -08:00
Alison Shao 2e14407983 Increase 5090 test parallelism from 4 to 8 (#17233) 2026-01-16 13:52:56 -08:00
Alison Shao b4fce9955a Add CI Coverage Overview workflow with detailed test listings (#16842) 2026-01-16 09:42:50 -08:00
Alison Shao 146b5fcc84 [CI] Reorganize stage-b 1-GPU tests for 5090 compatibility (#16826) 2026-01-15 15:23:35 -08:00
Alison Shao 69822c7271 Disable unit-test-deepep-8-gpu (#17176) 2026-01-15 15:12:45 -08:00
Alison Shao c5e363e8e0 test: split Qwen3 Next tests and disable PCG tests due to intermittent failures (#16989) 2026-01-13 20:18:42 -08:00
Alison Shao 9479eca75d [CI] Fix max_parallel for scheduled runs (#17046) 2026-01-13 20:16:32 -08:00
Alison Shao b880607108 Add 5090 dry run stage to PR test workflow (#17022) 2026-01-13 14:12:33 -08:00
Alison Shao 17cb3c8e49 Enable /rerun-stage workflow URL lookup for fork PRs (#16851) 2026-01-11 23:05:37 +08:00
Alison Shao cc25f9df50 Update est_time for stage-b-test-small-1-gpu tests (#16835) 2026-01-11 12:03:43 +08:00
Alison Shao 9c64a15ad4 feat: add workflow run URL to /rerun-stage comment (#16825) 2026-01-10 10:41:20 +08:00
Alison Shao ef35d8fe4e Migrate VLM tests and remove unit-test-backend-1-gpu job (#16679) 2026-01-09 15:24:26 -08:00
Alison Shao e46f79431b Fix external_models import path and migrate model loading tests (#16458) 2026-01-08 23:43:49 -08:00
Alison Shao a979927727 Skip causal_conv1d test with padded batches due to Triton kernel bug (#16715) 2026-01-08 15:13:13 -08:00
Alison Shao 63cc97f4ef ci: migrate 2-GPU tests to test/registered/ (#16529) 2026-01-07 20:28:16 -08:00
Alison Shao 3a4767daa3 Fix pytest tests to exit with proper exit code (#16681) 2026-01-07 15:20:46 -08:00
Alison Shao 0241e0460f Migrate tokenizer tests to test/registered/tokenizer/ (#16457) 2026-01-07 13:21:16 -08:00
Alison Shao 0c474273c5 Fix gpt_oss_common import path and migrate core tests (#16426) 2026-01-07 12:58:32 -08:00