minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity
17,903 Commits 3 Branches 0 Tags
a7117854754f52b0dd648d04094794de8102aa79
Commit Graph
49 Commits
Author SHA1 Message Date
Xiaoyu ZhangandMick Qian 4d23a4fa6d [Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436) 
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
 2026-09-07 15:13:59 +08:00
sglang-botandsglang-bot 6252993afe chore: update CI test est_time values (#38238) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-09-06 17:49:41 -07:00
Mickandmickqian 8ef646a5c6 fix(vlm): contain EPD request lifecycle failures (#36944) 
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
 2026-09-06 16:05:10 +08:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210) 
Co-authored-by: Alison Shao <a.shao@wustl.edu>
 2026-09-02 19:46:08 -07:00
cctryandYilong Zhao e5b3a48751 Add --http2-max-concurrent-streams server arg (#34796) 
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
 2026-08-15 10:34:49 -07:00
Shenxiu Liu fb97be4359 Fix Whisper transcription for audio over 30 seconds (#33604) 2026-08-15 23:51:05 +08:00
Liangsheng Yin 4792ab1e90 [CI] Pin the rust frontend parity test to eager prefill (#34146) 2026-08-08 20:07:19 -07:00
Liangsheng Yingithub-actions[bot]Harmya BhattharmyaXinyuanXinyuan TongXinyuan Tong
 		3c51e29deb Responses support (#32689) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Harmya Bhatt <harmyacs@gmail.com>
Co-authored-by: harmya <harmya@modal.com>
Co-authored-by: Xinyuan <xinyuan@radixark.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-08-07 13:21:46 -07:00
Liangsheng Yin de34dd11e9 [CI] Fold duplicate-server suites and prune the retract matrix on 1-gpu-5090 (#33745) 2026-08-05 12:41:51 -07:00
Chengyu LinandRain Jiang e00f32ed4f feat: rust sglang server openai apis (#33103) 
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
 2026-08-02 23:13:44 -07:00
Jairo David Campaña RoseroandXinyuan Tong b4dda8b3ce fix(anthropic): handle mid-conversation system messages (#26773) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-06-21 04:34:47 +00:00
Rain Jiang ef01618dfb support MPServer and embedded server for granian to enable muti tokenizer worker (#28573) 2026-06-18 17:59:12 -07:00
Liangsheng Yin b7d62bd724 [CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420) 2026-05-15 18:26:55 -07:00
Liangsheng Yin 22d3f3996c ci: decouple stage and runner for cuda registry (#25197) 2026-05-13 17:28:21 -07:00
Michael 245f7d8026 [AMD] Register 5 server-style 1-GPU tests for AMD PR CI (#24572) 2026-05-12 22:45:52 -07:00
Shenxiu LiuandXinyuan Tong a3fc982ba7 [Whisper] Automatic language detection via structured generation (#22997) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-04-27 15:54:41 +08:00
sglang-botandsglang-bot da175b964d chore: update CI test est_time values (#23785) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-26 20:17:50 -07:00
Liangsheng Yin bbd8f9ba09 migrate CPU-only unit tests from openai_server to unit/ (#22965) 2026-04-16 03:53:33 -07:00
ybyang fbd6dc3565 fix: normalize tool message content for GLM5.1 chat template (#22595) 2026-04-16 16:48:38 +08:00
Khoa PhamandClaude Opus 4.6 1f8df97054 Fix broken streaming response with --incremental-streaming-output (#22549) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-12 15:05:58 -07:00
Xinyuan Tong 7c6db40540 Fix tool call constrained decoding and parsing for models with native formats (#21593) 2026-04-10 20:37:23 -07:00
sglang-botCheng Wansglang-botCheng Wan
 		265696b176 chore: update CI test est_time values (#22565) 
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2026-04-10 18:15:02 -07:00
Yuhao Yang f5fd5ab622 add whisper test (#22302) 2026-04-10 15:34:53 +08:00
Alison ShaoAlison ShaoAlison Shao
 		45b0182205 [CI] Update est_time for 64 tests based on actual elapsed times (#22305) 
Co-authored-by: Alison Shao <alison.shao@Mac.lan>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-09 20:31:37 -07:00
Sundara Raman Ramachandran a64905a7b8 [CICD] [prefill-only] Consolidate prefill-only model E2E tests (#22405) 2026-04-09 00:54:34 -07:00
Ke Bao be42fbbbd7 Support HTTP2 server (#21700) 2026-04-08 00:42:52 +08:00
faceless void de9859073f Add --stream-response-default-include-usage server flag (#16711) 2026-04-03 21:36:00 -07:00
Sundara Raman Ramachandran 90e86800f4 [Score API] Implement EngineScoreMixin for scoring functionality and refactor Tok… (#21342) 2026-04-03 15:17:42 -07:00
Lianmin Zheng 814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
Lianmin Zheng dba6fb3d30 Fix streaming logprobs corruption caused by shared mutable list reference (#21030) 2026-03-21 00:18:48 -07:00
Javier Torres afc71bae3a feat: Add 'none' reasoning effort to ChatCompletionRequest (#20556) 2026-03-15 20:25:48 -07:00
Liangsheng Yin 116aef8504 [Test] Move embedding tests into test/registered/embedding/ and unit/ (#20642) 2026-03-15 14:48:43 -07:00
doujiang24 88d2fc19b1 feature: support X-Data-Parallel-Rank header to specific dp-rank. (#19832) 
Signed-off-by: doujiang24 <doujiang24@gmail.com>
 2026-03-11 14:53:33 -07:00
Charles Chen d22c6a3847 fix: Properly return abort error for streaming requests if the abort is triggered by scheduler (#19357) 2026-03-03 17:18:15 -08:00
Guy Stone f749802402 [Score API][18132] return token usage in Score API response (#18381) 2026-03-03 13:45:35 -08:00
Mohammad Miadh AngkadandXinyuan Tong 9c81ce4707 [Anthropic API] Preserve image content in tool_result conversion (#19233) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-02-28 12:07:22 -08:00
Xinyuan Tong 4a362a0e04 fix tool handling in OpenAIServingChat (#18996) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-02-21 22:07:09 +08:00
Xinyuan Tong cc451671b5 [FEAT] Add Anthropic compatible API endpoint (#18630) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-02-21 19:37:38 +08:00
Byron Hsu 5636d16dec [CI] Add logs to debug TestOpenAIServer.test_completion_stream (#17471) 2026-02-02 02:38:08 -08:00
Kangyan-ZhouandXinyuan Tong 592603d77b Fix flaky streaming logprobs test by handling detokenizer text buffering (#17687) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-01-25 15:09:06 -08:00
Lianmin Zhenggithub-actions[bot]Wangfan Fu
 		b74a57a8d9 [Auto Sync] Update detokenizer_manager.py, io_struct.py, mu... (20260120) (#17442) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
 2026-01-21 14:48:32 -08:00
YC Tseng 1a053a810c [AMD] CI - add partitions for stage-b-test-small-1-gpu-amd (#17345) 2026-01-19 08:16:07 -08:00
Bingxu Chenandyctseng0211 2ea02f0642 [AMD CI] Migrate and Add More Testcases (#17116) 
Co-authored-by: yctseng0211 <yctseng@amd.com>
 2026-01-19 08:07:39 -08:00
Alison Shao 146b5fcc84 [CI] Reorganize stage-b 1-GPU tests for 5090 compatibility (#16826) 2026-01-15 15:23:35 -08:00
shuwennandXinyuan Tong de94d793ad feat: support qwen3(-VL) rerank scoring&chat template (#16403) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-01-15 00:45:46 +08:00
Alison Shao b880607108 Add 5090 dry run stage to PR test workflow (#17022) 2026-01-13 14:12:33 -08:00
YC TsengandBingxu Chen 4e999404c3 [AMD] Fix CI - unit-test-backend-1-gpu-amd-mi35x and unit-test-backend-2-gpu-amd, stage-b-test-small-1-gpu-amd (#16675) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-08 10:16:27 -08:00
Harish 156d97b219 Fix KeyError when logprobs=false in completions endpoint (#16095) 2026-01-07 15:49:02 -08:00
Alison ShaoandKangyan-Zhou 0cbd8f3247 ci(test): migrate OpenAI server tests to registered CI system (#16326) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-01-06 11:09:37 -08:00