minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
5,455 Commits 3 Branches 0 Tags
7ca1bea63d2a3362812d4aaa5285fad3029e29d5
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Lianmin Zhengandgithub-actions[bot] f949ad5794 [Auto Sync] Update activation.py, chunk_cache.py, utils.py (20250917) (#10538) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-09-16 17:06:43 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		c49484a658 [Auto Sync] Update scheduler_profiler_mixin.py, rpd_utils.p... (20250916) (#10494) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-16 17:02:20 -07:00
Lianmin Zhengandcctry 31fb19a0a2 [Auto Sync] Update registry.py (20250915) (#10484) 
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-15 17:34:28 -07:00
Lianmin Zheng 50dc0c1e9c Run tests based on labels (#10456) 2025-09-15 00:29:20 -07:00
Lianmin Zheng f73aae0bfc Update GITHUB_TOKEN secret for documentation push (#10458) 2025-09-14 21:59:13 -07:00
Lianmin Zheng b354e3c90d [CI] Fix token key in label-pr.yml workflow (#10452) 2025-09-14 20:45:53 -07:00
Lianmin Zheng 65e6f48ce4 Update permissions in label-pr.yml (#10450) 2025-09-14 20:41:43 -07:00
Lianmin Zheng 0ec580a86c Fix label PR (#10445) 2025-09-14 20:33:09 -07:00
Lianmin Zheng 8f6a175803 Fix label pr for ci (#10441) 2025-09-14 19:48:06 -07:00
Lianmin Zheng b7d385e812 automatically label pr for ci (#10435) 2025-09-14 19:13:11 -07:00
Lianmin Zheng c9ec4cae5b Fix the style of sgl kernel (#10398) 2025-09-12 22:20:21 -07:00
Lianmin Zhengandgithub-actions[bot] cdddab056c [Auto Sync] Update xgrammar_backend.py (20250913) (#10395) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-09-12 17:46:56 -07:00
Lianmin Zhengandgithub-actions[bot] 2269cf1e2f [Auto Sync] Update base_grammar_backend.py, llguidance_back... (20250911) (#10333) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-09-12 12:55:55 -07:00
Lianmin Zhenggithub-actions[bot]Kan Wu
 		144ee5f37c [Auto Sync] Update server_args.py (20250912) (#10347) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
 2025-09-11 19:18:07 -07:00
Lianmin Zheng 64f296f8e6 [Minor] Improve the style of server args (#10328) 2025-09-11 07:06:29 -07:00
Lianmin Zhenggithub-actions[bot]Byron Hsu
 		956d805dde [Auto Sync] Update parallel_state.py (20250911) (#10326) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
 2025-09-11 06:36:29 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		033b75f559 [Auto Sync] Update serving_base.py, serving_chat.py, servin... (20250910) (#10282) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-10 16:58:59 -07:00
Lianmin Zhenggithub-actions[bot]Kan Wu
 		27760fc1b6 [Auto Sync] Update io_struct.py (20250910) (#10262) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
 2025-09-10 00:16:37 -07:00
Lianmin Zheng 676a7b51bd make --speculative-draft-model an alias of --speculative-draft-model-path (#10246) 2025-09-09 19:12:24 -07:00
Lianmin Zheng bcf1955f7e Revert "chore: upgrade v0.3.9 sgl-kernel" (#10245) 2025-09-09 19:05:20 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		a06bf66425 [Auto Sync] Update collector.py, startup_func_log_and_timer... (20250910) (#10242) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-09 18:05:16 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		bf72b80122 [Auto Sync] Update io_struct.py (20250909) (#10236) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-09 14:15:21 -07:00
Lianmin Zheng 4582931ac3 Revert "Revert the changes on NCCL symmetric memory" (#10238) 2025-09-09 12:11:49 -07:00
Lianmin ZhengandYineng Zhang d352c29aa0 Revert the changes on NCCL symmetric memory (#10210) 
Co-authored-by: Yineng Zhang <me@zhyncs.com>
 2025-09-09 11:01:33 -07:00
Lianmin Zhenggithub-actions[bot]cctry
 		71133a0426 [Auto Sync] Update sampling_batch_info.py (20250909) (#10212) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-09 01:29:52 -07:00
Lianmin Zheng 76a2c86b88 Fix flashinfer version in sgl-kernel (#10135) 2025-09-07 12:54:07 -07:00
Lianmin Zhenggithub-actions[bot]jzhou-xai
 		617aa2b248 [Auto Sync] Update parallel_state.py (20250907) (#10126) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>
 2025-09-07 02:12:32 -07:00
Lianmin Zhenggithub-actions[bot]Hanming Lu
 		f3b6760213 [Auto Sync] Update server_args.py (20250906) (#10117) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
 2025-09-06 16:59:36 -07:00
Lianmin Zhenggithub-actions[bot]Leon Gao
 		397448ebbc [Auto Sync] Update parallel_state.py, few_shot_gsm8k.py (20250903) (#9986) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Leon Gao <leon.gao19@gmail.com>
 2025-09-03 16:55:43 -07:00
Lianmin Zheng d631290e32 Remove annoying warnings in sgl kernel build (#9905) 2025-09-02 20:18:25 -07:00
Lianmin Zheng 60e37f8028 Move parsers under a single folder (#9912) 2025-09-02 18:25:04 -07:00
Lianmin ZhengandSheng Shen 25c7395934 Fix input logprob index (#9841) 
Co-authored-by: Sheng Shen <sheng.s@berkeley.edu>
 2025-08-31 02:56:47 -07:00
Lianmin Zheng 646076b71e Update guidelines for syncing code between repos (#9831) 2025-08-30 16:10:35 -07:00
Lianmin Zheng 0d04008936 [CI] Code sync tools (#9830) 2025-08-30 16:02:29 -07:00
Lianmin Zheng 05e4787243 [CI] Fix the trigger condition for PR test workflows (#9761) 2025-08-30 15:47:10 -07:00
Lianmin Zhenggithub-actions[bot]gemini-code-assist[bot]
 		1e61b4960f [Auto Sync] Update parallel_state.py (20250830) (#9828) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-08-30 14:25:39 -07:00
Lianmin Zhengandgithub-actions[bot] fce7ae33f8 [Sync] Update server_args.py (20250828) (#9745) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-08-28 10:33:00 -07:00
Lianmin Zhenggithub-actions[bot]Shiyang Chen
 		4aeba40d7b [Sync] Update mxfp4.py (20250827) (#9724) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Shiyang Chen <shiyang@x.ai>
 2025-08-27 17:00:09 -07:00
Lianmin Zheng fd71b11b1d move is_sm90_supported/is_sm100_supported to python/sglang/srt/utils.py (#9679) 2025-08-27 03:34:29 -07:00
Lianmin Zheng 97a38ee85b Release 0.5.1 (#9533) 2025-08-23 07:09:26 -07:00
Lianmin Zheng 86d10d220f Update grok.py and tiktoken tokenizer (#9532) 2025-08-23 05:40:18 -07:00
Lianmin Zheng 1ec9769753 [Docs] Update contribution guide (#9383) 2025-08-19 23:37:45 -07:00
Lianmin Zheng f20b6a3f2b [minor] Sync style changes (#9376) 2025-08-19 21:35:01 -07:00
Lianmin Zheng ecc9f3e47a [Minor] Fix the style of sgl-kernel (#9332) 2025-08-18 23:45:00 -07:00
Lianmin Zheng c480a3f6ea Minor style fixes for sgl-kernel (#9289) 2025-08-18 09:38:35 -07:00
Lianmin Zhengandgemini-code-assist[bot] 9e426466af Clean up allocators (#9134) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-08-13 13:56:04 -07:00
Lianmin Zheng 8c07fabda7 Update hyperparameter_tuning.md (#9083) 2025-08-11 13:44:11 -07:00
Lianmin Zheng 6beeff41c5 Update REVIEWERS.md (#9046) 2025-08-10 21:11:14 -07:00
Lianmin Zheng 2e8e7e353b Improve docs and developer guide (#9044) 2025-08-10 21:05:18 -07:00
Lianmin Zheng 2449a0afe2 Refactor the docs (#9031) 2025-08-10 19:49:45 -07:00
Lianmin Zheng 0f229c07f1 Update release-docs.yml (#9037) 2025-08-10 18:52:11 -07:00
Lianmin Zheng 4ea9d74a3e Simplify health check (#9034) 2025-08-10 17:35:05 -07:00
Lianmin Zheng f2887498f0 Simplify memory pool (#9033) 2025-08-10 17:32:28 -07:00
Lianmin Zheng 2c7f01bc89 Reorganize CI and test files (#9027) 2025-08-10 12:30:06 -07:00
Lianmin Zheng b58ae7a2a0 Simplify frontend language (#9029) 2025-08-10 10:59:30 -07:00
Lianmin Zheng ef48d5547e Fix CI (#9013) 2025-08-09 16:00:10 -07:00
Lianmin Zheng 9a44b643c6 Fix CI (#9012) 2025-08-09 13:33:42 -07:00
Lianmin Zheng 706bd69cc5 Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) 2025-08-08 19:56:50 -07:00
Lianmin ZhengandSuruchi Shah f352b793be Minor Optimizations in Schedule Batch (#8724) 
Co-authored-by: Suruchi Shah <surshah@linkedin.com>
 2025-08-08 16:10:16 -07:00
Lianmin Zheng 6642e3a295 [Fix] Add a workflow to cancel all pending CI runs (#8988) 2025-08-08 16:09:50 -07:00
Lianmin Zheng 67a7d1f699 Create cancel-all-pr-test-runs (#8986) 2025-08-08 15:53:51 -07:00
Lianmin Zheng 91e2f902db Fix kimi k2 function call format (#8968) 2025-08-08 13:25:14 -07:00
Lianmin Zheng a947154286 Revert "Support Multi Process Tokenizer Manager" (#8960) 2025-08-08 02:28:27 -07:00
Lianmin Zheng e314b084c5 [FIX] Fix the nightly CI by disabling swa mem pool for gemma2 (#8693) 2025-08-02 18:43:14 -07:00
Lianmin Zheng 07e46ecaad Update CODEOWNERS (#8686) 2025-08-01 15:09:44 -07:00
Lianmin Zheng a4c3b121d8 Split the scheduler into multiple mixin classes to reduce the file size (#8483) 2025-07-29 12:46:50 -07:00
Lianmin Zheng 813670660c Update README.md (#8528) 2025-07-29 04:09:19 -07:00
Lianmin Zheng 263c9236a0 Always trigger pr-test (#8527) 2025-07-29 04:05:19 -07:00
Lianmin Zheng 69712e6f55 Rename the last step in pr-test.yml as pr-test-finish (#8486) 2025-07-28 19:06:13 -07:00
Lianmin Zheng 001bffca62 Update CODEOWNERS (#8485) 2025-07-28 17:57:23 -07:00
Lianmin Zheng bd51694906 Update codeowner (#8476) 2025-07-28 16:03:49 -07:00
Lianmin Zheng 3ec0b21229 [CI] Fix flaky threshold (#8370) 2025-07-25 16:41:56 -07:00
Lianmin Zheng ed2e313eb6 Clean up server_args, triton cache manager (#8332) 2025-07-25 14:14:51 -07:00
Lianmin Zheng 55381a46ac Revert "[Feature] Simple Improve Health Check Mechanism for Production-Grade Stability" (#8181) 2025-07-19 22:41:30 -07:00
Lianmin Zheng bb0e8a32b5 Clean up server args (#8161) 2025-07-19 11:32:52 -07:00
Lianmin Zheng 1b427dae02 Update README.md (#8171) 2025-07-19 11:04:19 -07:00
Lianmin Zheng 9c7a46180c [Doc] Steps to add a new attention backend (#8155) 2025-07-18 16:38:26 -07:00
Lianmin Zheng 8d2cf38c79 [Minor] Remove redundant print (#8005) 2025-07-14 10:55:13 -07:00
Lianmin ZhengandPranjal Shankhdhar 5589b75024 Add treemask mode to build_eagle_tree & release sgl-kernel 0.2.3 (#7756) 
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
 2025-07-05 12:17:05 -07:00
Lianmin Zheng 14229ccf8f Move mem_fraction_static adjustment for multimodal models to server_args.py & Fix session control & Other cleanups (#7748) 2025-07-04 16:33:33 -07:00
Lianmin ZhengandKan Wu 22352d47a9 Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) 
Co-authored-by: Kan Wu <wukanustc@gmail.com>
 2025-06-29 23:16:19 -07:00
Lianmin Zheng 78700893ee [EAGLE] remove a wrong adjustment for page_size > 1 & topk > 1 in server_args.py (#7643) 2025-06-29 19:25:28 -07:00
Lianmin Zheng 663c04f76e Update CODEOWNERS (#7640) 2025-06-29 16:58:43 -07:00
Lianmin Zheng b2264076dc Add @mickqian as the CODEOWNERS of multimodal (#7636) 2025-06-29 09:27:33 -07:00
Lianmin Zheng 071a1f51ae [Minor] clean up multimodal processor and tokenizer manager (#7624) 2025-06-29 02:50:14 -07:00
Lianmin Zheng ce3a3e8783 Move multimodal processors into a separate folder (#7581) 2025-06-27 11:58:24 -07:00
Lianmin Zheng 55e03b10c4 Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457) 2025-06-23 06:20:39 -07:00
Lianmin Zheng 30ceccc74a Update hyperparameter_tuning.md (#7454) 2025-06-22 22:42:55 -07:00
Lianmin Zheng 1a9c2c9214 Fix AMD speculative decoding (#7252) 2025-06-16 17:01:33 -07:00
Lianmin Zheng c64290dcb5 Use seq_len_fill_value in the cuda graph runners (#7233) 2025-06-16 15:57:07 -07:00
Lianmin Zheng 53a525bf33 [Eagle] Fix kernel call after updating speculative sampling kernels (#7231) 2025-06-16 07:25:59 -07:00
Lianmin Zheng 7ddf8e83d2 [EAGLE] Fix draft kv cache layout for fa3 and topk > 1 (#7239) 2025-06-16 05:47:51 -07:00
Lianmin Zheng 8321f8e45e Release sgl-kernel 0.1.9 (#7232) 2025-06-16 03:37:40 -07:00
Lianmin Zheng cfceb83d05 Fix sampling for speculative decoding & simplify kernels (#7207) 2025-06-16 03:28:30 -07:00
Lianmin Zheng b1286a116a [EAGLE] Refactor code for page size > 1 & more simplifications (#7213) 2025-06-16 03:04:29 -07:00
Lianmin Zheng 21615cc3fe Minor style and doc fix (#7228) 2025-06-16 01:03:13 -07:00
Lianmin Zheng fff10809bf Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210) 2025-06-15 02:48:00 -07:00
Lianmin Zheng 5f1ab32717 [EAGLE] Refactor code for page size > 1 & more simplifications (#7163) 2025-06-14 23:16:23 -07:00
Lianmin Zheng 38af4f68a9 Fix grammar abort & Minor style fixes (#7204) 2025-06-14 22:49:41 -07:00
Lianmin Zheng a6305c7d50 Lianmin/simplify memory pool (#7202) 2025-06-14 22:25:37 -07:00