minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
5,953 Commits 3 Branches 0 Tags
91fc5bb5a98a1d7893d5782031baa362ff605ade
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Lianmin Zheng d314bf6010 Update install.md (#11631) 2025-10-14 14:34:46 -07:00
Lianmin Zhenggithub-actions[bot]Byron Hsu
 		b98cf39866 [Auto Sync] Update collector.py (20251014) (#11625) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
 2025-10-14 13:34:33 -07:00
Lianmin Zhenggithub-actions[bot]Stefan He
 		27d710457c [Auto Sync] Update scheduler.py, server_args.py (20251014) (#11623) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
 2025-10-14 13:20:03 -07:00
Lianmin Zheng f7f9f8eceb Update news section in README.md (#11598) 2025-10-14 00:49:39 -07:00
Lianmin Zhenggithub-actions[bot]Hanming Lu
 		ba2ce28fe9 [Auto Sync] Update model_config.py (20251014) (#11580) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
 2025-10-13 22:16:34 -07:00
Lianmin Zheng 5e3f7e7fa9 Minor: improve sampler & remove unused fields from model_config.py (#11531) 2025-10-13 11:04:44 -07:00
Lianmin Zheng 2ac46e94ef Sync changes on io_struct.py and deterministic ops (#11498) 2025-10-12 16:03:10 -07:00
Lianmin Zheng 5a6ec8f999 Fix unit tests (#11503) 2025-10-12 07:45:57 -07:00
Lianmin Zheng 6a653bb11b temporarily remove b200 tests (#11502) 2025-10-12 06:48:49 -07:00
Lianmin Zheng 548a57b1f3 Fix port conflicts in CI (#11497) 2025-10-12 06:46:36 -07:00
Lianmin Zheng 88e73ed048 Temporarily remove b200 tests (#11501) 2025-10-12 06:41:37 -07:00
Lianmin Zheng 61055cb309 Reorder PD disagg CI tests (#11438) 2025-10-10 17:56:49 -07:00
Lianmin Zheng b4408e6098 Revert "fix: fix video input for qwen3-vl" (#11437) 2025-10-10 12:44:40 -07:00
Lianmin Zheng 9b8ebb2798 move more files under srt/utils (#11285) 2025-10-09 16:46:15 -07:00
Lianmin Zheng 708f4ff490 Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) 2025-10-06 15:50:56 -07:00
Lianmin Zhenggithub-actions[bot]Sehoon Kim
 		e2daeb351c [Auto Sync] Update test_utils.py (20251006) (#11280) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
 2025-10-06 15:49:57 -07:00
Lianmin Zheng 0e7b353009 Fix code sync scripts (#11276) 2025-10-06 15:35:01 -07:00
Lianmin Zheng eb30b888db Remove env var warnings for release (#11262) 2025-10-06 10:09:17 -07:00
Lianmin Zheng b6b4b56395 Update condition for sgl-kernel-benchmark-test (#11254) 2025-10-05 20:55:02 -07:00
Lianmin Zheng f8924ad74b update sgl kernel version to 0.3.14.post1 (#11242) 2025-10-05 20:30:40 -07:00
Lianmin Zheng 366a603e95 Use cu128 for torch audio to fix some CI tests (#11251) 2025-10-05 19:52:32 -07:00
Lianmin Zhenggithub-actions[bot]jzhou-xai
 		6b30e097ab [Auto Sync] Update io_struct.py (20251004) (#11206) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>
 2025-10-05 18:06:07 -07:00
Lianmin Zheng d645ae90a3 Rename runner labels (#11228) 2025-10-05 18:05:41 -07:00
Lianmin Zheng 148d8d485d Update DeepGEMM repository tag to specific commit (#11229) 2025-10-05 13:47:36 -07:00
Lianmin Zheng 6a261aaca5 Minor fixes for server_args, parallel_state, and test_deterministic.py (#11159) 2025-10-02 12:12:49 -07:00
Lianmin Zheng 097725bb66 Clean up parallel_state.py (#11148) 2025-10-02 01:09:13 -07:00
Lianmin Zheng 609f65ba23 Remove debug print statement from scheduler output (#11145) 2025-10-01 13:37:05 -07:00
Lianmin Zheng 2d62af6be5 Fix metrics and request tracing (TimeStats) (#11123) 2025-10-01 13:03:07 -07:00
Lianmin Zhenggithub-actions[bot]Sehoon Kim
 		5dddb331c4 [Auto Sync] Update base_grammar_backend.py, xgrammar_backen... (20250930) (#11115) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
 2025-09-30 21:50:43 -07:00
Lianmin Zhenggithub-actions[bot]Cheng Wan
 		1237aa19ce [Auto Sync] Update fused_moe_triton_config.py (20250930) (#11099) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2025-09-30 00:57:16 -07:00
Lianmin Zheng e5281f84d5 Update CODEOWNERS for attention/ascend_backend.py (#11092) 2025-09-29 21:28:49 -07:00
Lianmin Zheng dda34c2f93 Fix mem fraction static for nightly tests (#11076) 2025-09-29 12:57:41 -07:00
Lianmin Zhengandsglang-bot a17e70f5cc Use more general heuristics to set the default value of --mem-fraction-static (#10975) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-09-29 10:11:03 -07:00
Lianmin Zheng 07440f5f34 Fix FusedSetKVBufferArg in RotaryEmbedding (#11003) 2025-09-28 11:17:27 -07:00
Lianmin Zheng f6bc3f529b Fix profiler (#10997) 2025-09-27 14:56:18 -07:00
Lianmin Zheng e56c64bfaf Update label field comment to indicate deprecation (#10970) 2025-09-26 12:59:59 -07:00
Lianmin Zheng 3e95aa1a09 Remove pull_request trigger from CI monitor workflow (#10932) 2025-09-25 19:40:38 -07:00
Lianmin ZhengYingchun Laigemini-code-assist[bot]
 		f68dd998b9 Rename customer label -> custom label (#10899) 
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-25 16:19:53 -07:00
Lianmin Zheng 35ec2a45a8 [minor] Remove deprecated function get_ip (#10883) 2025-09-25 16:18:04 -07:00
Lianmin Zhenggithub-actions[bot]Hanming Lu
 		3e43eb137b [Auto Sync] Update model_config.py (20250925) (#10885) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
 2025-09-24 22:59:16 -07:00
Lianmin Zheng b1f0fc1c0b Add CI timeout guidelines (#10829) 2025-09-23 22:08:02 -07:00
Lianmin Zheng 32d893730f Revert "[fix][pd-disag]no need set next batch sampling info done in prefill" (#10828) 2025-09-23 17:02:01 -07:00
Lianmin Zhengandgithub-actions[bot] f47a2c67e6 [Auto Sync] Update load_config.py, model_config.py, configu... (20250923) (#10825) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-09-23 16:48:12 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		312bfc4c95 [Auto Sync] Update simple_eval_common.py (20250923) (#10824) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-23 13:50:47 -07:00
Lianmin Zhenggithub-actions[bot]Cheng Wan
 		e290303ea1 [Auto Sync] Update elementwise.py (20250923) (#10823) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2025-09-23 13:50:22 -07:00
Lianmin Zheng ea338676b5 Clean up server args (#10770) 2025-09-23 00:22:32 -07:00
Lianmin Zhengandgithub-actions[bot] 113f8f65a2 [Auto Sync] Update configurer.py (20250923) (#10765) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-09-22 17:34:34 -07:00
Lianmin Zhengandcctry 38c00ed7a1 Fix multimodal registry and code sync scripts (#10759) 
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-22 15:36:01 -07:00
Lianmin Zhengandgithub-actions[bot] f949ad5794 [Auto Sync] Update activation.py, chunk_cache.py, utils.py (20250917) (#10538) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-09-16 17:06:43 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		c49484a658 [Auto Sync] Update scheduler_profiler_mixin.py, rpd_utils.p... (20250916) (#10494) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-16 17:02:20 -07:00
Lianmin Zhengandcctry 31fb19a0a2 [Auto Sync] Update registry.py (20250915) (#10484) 
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-15 17:34:28 -07:00
Lianmin Zheng 50dc0c1e9c Run tests based on labels (#10456) 2025-09-15 00:29:20 -07:00
Lianmin Zheng f73aae0bfc Update GITHUB_TOKEN secret for documentation push (#10458) 2025-09-14 21:59:13 -07:00
Lianmin Zheng b354e3c90d [CI] Fix token key in label-pr.yml workflow (#10452) 2025-09-14 20:45:53 -07:00
Lianmin Zheng 65e6f48ce4 Update permissions in label-pr.yml (#10450) 2025-09-14 20:41:43 -07:00
Lianmin Zheng 0ec580a86c Fix label PR (#10445) 2025-09-14 20:33:09 -07:00
Lianmin Zheng 8f6a175803 Fix label pr for ci (#10441) 2025-09-14 19:48:06 -07:00
Lianmin Zheng b7d385e812 automatically label pr for ci (#10435) 2025-09-14 19:13:11 -07:00
Lianmin Zheng c9ec4cae5b Fix the style of sgl kernel (#10398) 2025-09-12 22:20:21 -07:00
Lianmin Zhengandgithub-actions[bot] cdddab056c [Auto Sync] Update xgrammar_backend.py (20250913) (#10395) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-09-12 17:46:56 -07:00
Lianmin Zhengandgithub-actions[bot] 2269cf1e2f [Auto Sync] Update base_grammar_backend.py, llguidance_back... (20250911) (#10333) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-09-12 12:55:55 -07:00
Lianmin Zhenggithub-actions[bot]Kan Wu
 		144ee5f37c [Auto Sync] Update server_args.py (20250912) (#10347) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
 2025-09-11 19:18:07 -07:00
Lianmin Zheng 64f296f8e6 [Minor] Improve the style of server args (#10328) 2025-09-11 07:06:29 -07:00
Lianmin Zhenggithub-actions[bot]Byron Hsu
 		956d805dde [Auto Sync] Update parallel_state.py (20250911) (#10326) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
 2025-09-11 06:36:29 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		033b75f559 [Auto Sync] Update serving_base.py, serving_chat.py, servin... (20250910) (#10282) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-10 16:58:59 -07:00
Lianmin Zhenggithub-actions[bot]Kan Wu
 		27760fc1b6 [Auto Sync] Update io_struct.py (20250910) (#10262) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
 2025-09-10 00:16:37 -07:00
Lianmin Zheng 676a7b51bd make --speculative-draft-model an alias of --speculative-draft-model-path (#10246) 2025-09-09 19:12:24 -07:00
Lianmin Zheng bcf1955f7e Revert "chore: upgrade v0.3.9 sgl-kernel" (#10245) 2025-09-09 19:05:20 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		a06bf66425 [Auto Sync] Update collector.py, startup_func_log_and_timer... (20250910) (#10242) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-09 18:05:16 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		bf72b80122 [Auto Sync] Update io_struct.py (20250909) (#10236) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-09 14:15:21 -07:00
Lianmin Zheng 4582931ac3 Revert "Revert the changes on NCCL symmetric memory" (#10238) 2025-09-09 12:11:49 -07:00
Lianmin ZhengandYineng Zhang d352c29aa0 Revert the changes on NCCL symmetric memory (#10210) 
Co-authored-by: Yineng Zhang <me@zhyncs.com>
 2025-09-09 11:01:33 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		71133a0426 [Auto Sync] Update sampling_batch_info.py (20250909) (#10212) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-09 01:29:52 -07:00
Lianmin Zheng 76a2c86b88 Fix flashinfer version in sgl-kernel (#10135) 2025-09-07 12:54:07 -07:00
Lianmin Zhenggithub-actions[bot]jzhou-xai
 		617aa2b248 [Auto Sync] Update parallel_state.py (20250907) (#10126) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>
 2025-09-07 02:12:32 -07:00
Lianmin Zhenggithub-actions[bot]Hanming Lu
 		f3b6760213 [Auto Sync] Update server_args.py (20250906) (#10117) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
 2025-09-06 16:59:36 -07:00
Lianmin Zhenggithub-actions[bot]Leon Gao
 		397448ebbc [Auto Sync] Update parallel_state.py, few_shot_gsm8k.py (20250903) (#9986) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Leon Gao <leon.gao19@gmail.com>
 2025-09-03 16:55:43 -07:00
Lianmin Zheng d631290e32 Remove annoying warnings in sgl kernel build (#9905) 2025-09-02 20:18:25 -07:00
Lianmin Zheng 60e37f8028 Move parsers under a single folder (#9912) 2025-09-02 18:25:04 -07:00
Lianmin ZhengandSheng Shen 25c7395934 Fix input logprob index (#9841) 
Co-authored-by: Sheng Shen <sheng.s@berkeley.edu>
 2025-08-31 02:56:47 -07:00
Lianmin Zheng 646076b71e Update guidelines for syncing code between repos (#9831) 2025-08-30 16:10:35 -07:00
Lianmin Zheng 0d04008936 [CI] Code sync tools (#9830) 2025-08-30 16:02:29 -07:00
Lianmin Zheng 05e4787243 [CI] Fix the trigger condition for PR test workflows (#9761) 2025-08-30 15:47:10 -07:00
Lianmin Zhenggithub-actions[bot]gemini-code-assist[bot]
 		1e61b4960f [Auto Sync] Update parallel_state.py (20250830) (#9828) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-08-30 14:25:39 -07:00
Lianmin Zhengandgithub-actions[bot] fce7ae33f8 [Sync] Update server_args.py (20250828) (#9745) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-08-28 10:33:00 -07:00
Lianmin Zhenggithub-actions[bot]Shiyang Chen
 		4aeba40d7b [Sync] Update mxfp4.py (20250827) (#9724) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Shiyang Chen <shiyang@x.ai>
 2025-08-27 17:00:09 -07:00
Lianmin Zheng fd71b11b1d move is_sm90_supported/is_sm100_supported to python/sglang/srt/utils.py (#9679) 2025-08-27 03:34:29 -07:00
Lianmin Zheng 97a38ee85b Release 0.5.1 (#9533) 2025-08-23 07:09:26 -07:00
Lianmin Zheng 86d10d220f Update grok.py and tiktoken tokenizer (#9532) 2025-08-23 05:40:18 -07:00
Lianmin Zheng 1ec9769753 [Docs] Update contribution guide (#9383) 2025-08-19 23:37:45 -07:00
Lianmin Zheng f20b6a3f2b [minor] Sync style changes (#9376) 2025-08-19 21:35:01 -07:00
Lianmin Zheng ecc9f3e47a [Minor] Fix the style of sgl-kernel (#9332) 2025-08-18 23:45:00 -07:00
Lianmin Zheng c480a3f6ea Minor style fixes for sgl-kernel (#9289) 2025-08-18 09:38:35 -07:00
Lianmin Zhengandgemini-code-assist[bot] 9e426466af Clean up allocators (#9134) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-08-13 13:56:04 -07:00
Lianmin Zheng 8c07fabda7 Update hyperparameter_tuning.md (#9083) 2025-08-11 13:44:11 -07:00
Lianmin Zheng 6beeff41c5 Update REVIEWERS.md (#9046) 2025-08-10 21:11:14 -07:00
Lianmin Zheng 2e8e7e353b Improve docs and developer guide (#9044) 2025-08-10 21:05:18 -07:00
Lianmin Zheng 2449a0afe2 Refactor the docs (#9031) 2025-08-10 19:49:45 -07:00
Lianmin Zheng 0f229c07f1 Update release-docs.yml (#9037) 2025-08-10 18:52:11 -07:00
Lianmin Zheng 4ea9d74a3e Simplify health check (#9034) 2025-08-10 17:35:05 -07:00