 Lianmin Zheng
|
646076b71e
|
Update guidelines for syncing code between repos (#9831)
|
2025-08-30 16:10:35 -07:00 |
|
|
Lianmin Zheng
|
0d04008936
|
[CI] Code sync tools (#9830)
|
2025-08-30 16:02:29 -07:00 |
|
|
Lianmin Zheng
|
05e4787243
|
[CI] Fix the trigger condition for PR test workflows (#9761)
|
2025-08-30 15:47:10 -07:00 |
|
|
|
1e61b4960f
|
[Auto Sync] Update parallel_state.py (20250830) (#9828)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-08-30 14:25:39 -07:00 |
|
|
Lianmin Zhengandgithub-actions[bot]
|
fce7ae33f8
|
[Sync] Update server_args.py (20250828) (#9745)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-08-28 10:33:00 -07:00 |
|
|
|
4aeba40d7b
|
[Sync] Update mxfp4.py (20250827) (#9724)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Shiyang Chen <shiyang@x.ai>
|
2025-08-27 17:00:09 -07:00 |
|
|
Lianmin Zheng
|
fd71b11b1d
|
move is_sm90_supported/is_sm100_supported to python/sglang/srt/utils.py (#9679)
|
2025-08-27 03:34:29 -07:00 |
|
|
Lianmin Zheng
|
97a38ee85b
|
Release 0.5.1 (#9533)
|
2025-08-23 07:09:26 -07:00 |
|
|
Lianmin Zheng
|
86d10d220f
|
Update grok.py and tiktoken tokenizer (#9532)
|
2025-08-23 05:40:18 -07:00 |
|
|
Lianmin Zheng
|
1ec9769753
|
[Docs] Update contribution guide (#9383)
|
2025-08-19 23:37:45 -07:00 |
|
|
Lianmin Zheng
|
f20b6a3f2b
|
[minor] Sync style changes (#9376)
|
2025-08-19 21:35:01 -07:00 |
|
|
Lianmin Zheng
|
ecc9f3e47a
|
[Minor] Fix the style of sgl-kernel (#9332)
|
2025-08-18 23:45:00 -07:00 |
|
|
Lianmin Zheng
|
c480a3f6ea
|
Minor style fixes for sgl-kernel (#9289)
|
2025-08-18 09:38:35 -07:00 |
|
|
Lianmin Zhengandgemini-code-assist[bot]
|
9e426466af
|
Clean up allocators (#9134)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-08-13 13:56:04 -07:00 |
|
|
Lianmin Zheng
|
8c07fabda7
|
Update hyperparameter_tuning.md (#9083)
|
2025-08-11 13:44:11 -07:00 |
|
|
Lianmin Zheng
|
6beeff41c5
|
Update REVIEWERS.md (#9046)
|
2025-08-10 21:11:14 -07:00 |
|
|
Lianmin Zheng
|
2e8e7e353b
|
Improve docs and developer guide (#9044)
|
2025-08-10 21:05:18 -07:00 |
|
|
Lianmin Zheng
|
2449a0afe2
|
Refactor the docs (#9031)
|
2025-08-10 19:49:45 -07:00 |
|
|
Lianmin Zheng
|
0f229c07f1
|
Update release-docs.yml (#9037)
|
2025-08-10 18:52:11 -07:00 |
|
|
Lianmin Zheng
|
4ea9d74a3e
|
Simplify health check (#9034)
|
2025-08-10 17:35:05 -07:00 |
|
|
Lianmin Zheng
|
f2887498f0
|
Simplify memory pool (#9033)
|
2025-08-10 17:32:28 -07:00 |
|
|
Lianmin Zheng
|
2c7f01bc89
|
Reorganize CI and test files (#9027)
|
2025-08-10 12:30:06 -07:00 |
|
|
Lianmin Zheng
|
b58ae7a2a0
|
Simplify frontend language (#9029)
|
2025-08-10 10:59:30 -07:00 |
|
|
Lianmin Zheng
|
ef48d5547e
|
Fix CI (#9013)
|
2025-08-09 16:00:10 -07:00 |
|
|
Lianmin Zheng
|
9a44b643c6
|
Fix CI (#9012)
|
2025-08-09 13:33:42 -07:00 |
|
|
Lianmin Zheng
|
706bd69cc5
|
Clean up server_args.py to have a dedicated function for model specific adjustments (#8983)
|
2025-08-08 19:56:50 -07:00 |
|
|
Lianmin ZhengandSuruchi Shah
|
f352b793be
|
Minor Optimizations in Schedule Batch (#8724)
Co-authored-by: Suruchi Shah <surshah@linkedin.com>
|
2025-08-08 16:10:16 -07:00 |
|
|
Lianmin Zheng
|
6642e3a295
|
[Fix] Add a workflow to cancel all pending CI runs (#8988)
|
2025-08-08 16:09:50 -07:00 |
|
|
Lianmin Zheng
|
67a7d1f699
|
Create cancel-all-pr-test-runs (#8986)
|
2025-08-08 15:53:51 -07:00 |
|
|
Lianmin Zheng
|
91e2f902db
|
Fix kimi k2 function call format (#8968)
|
2025-08-08 13:25:14 -07:00 |
|
|
Lianmin Zheng
|
a947154286
|
Revert "Support Multi Process Tokenizer Manager" (#8960)
|
2025-08-08 02:28:27 -07:00 |
|
|
Lianmin Zheng
|
e314b084c5
|
[FIX] Fix the nightly CI by disabling swa mem pool for gemma2 (#8693)
|
2025-08-02 18:43:14 -07:00 |
|
|
Lianmin Zheng
|
07e46ecaad
|
Update CODEOWNERS (#8686)
|
2025-08-01 15:09:44 -07:00 |
|
|
Lianmin Zheng
|
a4c3b121d8
|
Split the scheduler into multiple mixin classes to reduce the file size (#8483)
|
2025-07-29 12:46:50 -07:00 |
|
|
Lianmin Zheng
|
813670660c
|
Update README.md (#8528)
|
2025-07-29 04:09:19 -07:00 |
|
|
Lianmin Zheng
|
263c9236a0
|
Always trigger pr-test (#8527)
|
2025-07-29 04:05:19 -07:00 |
|
|
Lianmin Zheng
|
69712e6f55
|
Rename the last step in pr-test.yml as pr-test-finish (#8486)
|
2025-07-28 19:06:13 -07:00 |
|
|
Lianmin Zheng
|
001bffca62
|
Update CODEOWNERS (#8485)
|
2025-07-28 17:57:23 -07:00 |
|
|
Lianmin Zheng
|
bd51694906
|
Update codeowner (#8476)
|
2025-07-28 16:03:49 -07:00 |
|
|
Lianmin Zheng
|
3ec0b21229
|
[CI] Fix flaky threshold (#8370)
|
2025-07-25 16:41:56 -07:00 |
|
|
Lianmin Zheng
|
ed2e313eb6
|
Clean up server_args, triton cache manager (#8332)
|
2025-07-25 14:14:51 -07:00 |
|
|
Lianmin Zheng
|
55381a46ac
|
Revert "[Feature] Simple Improve Health Check Mechanism for Production-Grade Stability" (#8181)
|
2025-07-19 22:41:30 -07:00 |
|
|
Lianmin Zheng
|
bb0e8a32b5
|
Clean up server args (#8161)
|
2025-07-19 11:32:52 -07:00 |
|
|
Lianmin Zheng
|
1b427dae02
|
Update README.md (#8171)
|
2025-07-19 11:04:19 -07:00 |
|
|
Lianmin Zheng
|
9c7a46180c
|
[Doc] Steps to add a new attention backend (#8155)
|
2025-07-18 16:38:26 -07:00 |
|
|
Lianmin Zheng
|
8d2cf38c79
|
[Minor] Remove redundant print (#8005)
|
2025-07-14 10:55:13 -07:00 |
|
|
Lianmin ZhengandPranjal Shankhdhar
|
5589b75024
|
Add treemask mode to build_eagle_tree & release sgl-kernel 0.2.3 (#7756)
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
|
2025-07-05 12:17:05 -07:00 |
|
|
Lianmin Zheng
|
14229ccf8f
|
Move mem_fraction_static adjustment for multimodal models to server_args.py & Fix session control & Other cleanups (#7748)
|
2025-07-04 16:33:33 -07:00 |
|
|
Lianmin ZhengandKan Wu
|
22352d47a9
|
Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)
Co-authored-by: Kan Wu <wukanustc@gmail.com>
|
2025-06-29 23:16:19 -07:00 |
|
|
Lianmin Zheng
|
78700893ee
|
[EAGLE] remove a wrong adjustment for page_size > 1 & topk > 1 in server_args.py (#7643)
|
2025-06-29 19:25:28 -07:00 |
|
|
Lianmin Zheng
|
663c04f76e
|
Update CODEOWNERS (#7640)
|
2025-06-29 16:58:43 -07:00 |
|
|
Lianmin Zheng
|
b2264076dc
|
Add @mickqian as the CODEOWNERS of multimodal (#7636)
|
2025-06-29 09:27:33 -07:00 |
|
|
Lianmin Zheng
|
071a1f51ae
|
[Minor] clean up multimodal processor and tokenizer manager (#7624)
|
2025-06-29 02:50:14 -07:00 |
|
|
Lianmin Zheng
|
ce3a3e8783
|
Move multimodal processors into a separate folder (#7581)
|
2025-06-27 11:58:24 -07:00 |
|
|
Lianmin Zheng
|
55e03b10c4
|
Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457)
|
2025-06-23 06:20:39 -07:00 |
|
|
Lianmin Zheng
|
30ceccc74a
|
Update hyperparameter_tuning.md (#7454)
|
2025-06-22 22:42:55 -07:00 |
|
|
Lianmin Zheng
|
1a9c2c9214
|
Fix AMD speculative decoding (#7252)
|
2025-06-16 17:01:33 -07:00 |
|
|
Lianmin Zheng
|
c64290dcb5
|
Use seq_len_fill_value in the cuda graph runners (#7233)
|
2025-06-16 15:57:07 -07:00 |
|
|
Lianmin Zheng
|
53a525bf33
|
[Eagle] Fix kernel call after updating speculative sampling kernels (#7231)
|
2025-06-16 07:25:59 -07:00 |
|
|
Lianmin Zheng
|
7ddf8e83d2
|
[EAGLE] Fix draft kv cache layout for fa3 and topk > 1 (#7239)
|
2025-06-16 05:47:51 -07:00 |
|
|
Lianmin Zheng
|
8321f8e45e
|
Release sgl-kernel 0.1.9 (#7232)
|
2025-06-16 03:37:40 -07:00 |
|
|
Lianmin Zheng
|
cfceb83d05
|
Fix sampling for speculative decoding & simplify kernels (#7207)
|
2025-06-16 03:28:30 -07:00 |
|
|
Lianmin Zheng
|
b1286a116a
|
[EAGLE] Refactor code for page size > 1 & more simplifications (#7213)
|
2025-06-16 03:04:29 -07:00 |
|
|
Lianmin Zheng
|
21615cc3fe
|
Minor style and doc fix (#7228)
|
2025-06-16 01:03:13 -07:00 |
|
|
Lianmin Zheng
|
fff10809bf
|
Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210)
|
2025-06-15 02:48:00 -07:00 |
|
|
Lianmin Zheng
|
5f1ab32717
|
[EAGLE] Refactor code for page size > 1 & more simplifications (#7163)
|
2025-06-14 23:16:23 -07:00 |
|
|
Lianmin Zheng
|
38af4f68a9
|
Fix grammar abort & Minor style fixes (#7204)
|
2025-06-14 22:49:41 -07:00 |
|
|
Lianmin Zheng
|
a6305c7d50
|
Lianmin/simplify memory pool (#7202)
|
2025-06-14 22:25:37 -07:00 |
|
|
Lianmin Zheng
|
a023856b12
|
Move host memory pools into a separate file (#7200)
|
2025-06-14 21:31:42 -07:00 |
|
|
Lianmin Zheng
|
f47a1b1d0f
|
Increase timeout in test/srt/test_disaggregation.py (#7175)
|
2025-06-13 23:12:14 -07:00 |
|
|
Lianmin Zheng
|
ba589b88fc
|
Improve test cases for eagle infer (#7173)
|
2025-06-13 22:25:13 -07:00 |
|
|
Lianmin Zheng
|
0fc3d992bb
|
Split the eagle test into two files (#7170)
|
2025-06-13 20:14:26 -07:00 |
|
|
Lianmin Zheng
|
be2d985df8
|
Minor style change of triton backend (#7165)
|
2025-06-13 16:01:23 -07:00 |
|
|
Lianmin Zheng
|
dcc79d325b
|
Update CODEOWNERS (#7126)
|
2025-06-12 02:12:49 -07:00 |
|
|
Lianmin Zheng
|
dbdf76ca98
|
Clean up docs for server args and sampling parameters (generated by grok) (#7076)
|
2025-06-10 19:55:42 -07:00 |
|
|
Lianmin Zheng
|
6b12d6a8d5
|
Simplify the heuristics for setting --mem-fraction-static (#7054)
|
2025-06-10 19:01:39 -07:00 |
|
|
Lianmin Zheng
|
0f218731e3
|
Do not run frontend_reasoning.ipynb to reduce the CI load (#7073)
|
2025-06-10 17:15:31 -07:00 |
|
|
Lianmin Zheng
|
90bd3e32d6
|
Improve perf tuning docs (#7071)
|
2025-06-10 16:55:04 -07:00 |
|
|
Lianmin Zheng
|
4a102a2b02
|
Minor style fix in cuda_graph_runner.py (#7053)
|
2025-06-10 06:32:41 -07:00 |
|
|
Lianmin Zheng
|
6406408a70
|
Clean up server_args.py (#7037)
|
2025-06-10 05:34:29 -07:00 |
|
|
Lianmin Zheng
|
019851d099
|
Fix eagle on AMD (#7051)
|
2025-06-10 05:22:40 -07:00 |
|
|
Lianmin Zheng
|
2dae104dca
|
Minor cleanup of fa3 backend (#6999)
|
2025-06-10 03:58:44 -07:00 |
|
|
Lianmin Zheng
|
bb185b0e92
|
Update README.md (#7040)
|
2025-06-10 01:59:14 -07:00 |
|
|
Lianmin Zheng
|
dc0705a504
|
Simplify prepare_extend_after_decode (#6987)
|
2025-06-09 16:39:21 -07:00 |
|
|
Lianmin Zheng
|
9d5fa68b90
|
Use torch.compile to fuse flash attention decode metadata preparation (#6973)
|
2025-06-08 23:05:40 -07:00 |
|
|
Lianmin Zheng
|
9ecb18568b
|
Fix triton sliding window test case (#6981)
|
2025-06-08 17:20:46 -07:00 |
|
|
Lianmin Zheng
|
0c1f03a23d
|
Sync cuda graph runners (#6976)
|
2025-06-08 16:12:25 -07:00 |
|
|
Lianmin Zheng
|
20d3ad3b58
|
Fix CI and triton moe Configs (#6974)
|
2025-06-08 05:06:46 -07:00 |
|
|
Lianmin Zheng
|
608668e143
|
Slightly improve the sampler to skip unnecessary steps (#6956)
|
2025-06-08 03:18:54 -07:00 |
|
|
Lianmin Zheng
|
60fdad7cf3
|
Sync the changes on cuda graph runners (#6932)
|
2025-06-06 18:23:52 -07:00 |
|
|
Lianmin Zheng
|
e6b7053b60
|
Fix a bug in abort & Improve docstrings for abort (#6931)
|
2025-06-06 14:35:45 -07:00 |
|
|
Lianmin Zheng
|
20fd53b8f6
|
Correctly abort the failed grammar requests & Improve the handling of abort (#6803)
|
2025-06-01 19:00:07 -07:00 |
|
|
Lianmin Zheng
|
2d72fc47cf
|
Improve profiler and integrate profiler in bench_one_batch_server (#6787)
|
2025-05-31 15:53:55 -07:00 |
|
|
Lianmin Zheng
|
03886917bd
|
Disable all two stream overlap on amd (#6475)
|
2025-05-20 19:06:59 -07:00 |
|
|
Lianmin Zheng
|
b3f3d610fd
|
Do not use FA3 for mistral (#6379)
|
2025-05-17 19:47:34 -07:00 |
|
|
Lianmin Zheng
|
4bb816d444
|
Fix CI tests (#6362)
|
2025-05-17 19:16:45 -07:00 |
|
|
Lianmin Zheng
|
dcc0a45618
|
Fix amd ci (#6360)
|
2025-05-16 15:33:10 -07:00 |
|
|
Lianmin Zheng
|
c2b7ddca49
|
[Minor] cleanup unused imports (#6358)
|
2025-05-16 14:52:38 -07:00 |
|
|
Lianmin Zheng
|
abebd9399c
|
Update CODEOWNERS (#6359)
|
2025-05-16 14:51:36 -07:00 |
|
|
Lianmin Zheng
|
e07a6977e7
|
Minor improvements of TokenizerManager / health check (#6327)
|
2025-05-15 15:29:25 -07:00 |
|