|
e4cbb28ea1
|
[router] Improve SGLang chat render parity (#39133)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-17 23:53:40 +08:00 |
|
|
Kan WuandClaude Fable 5.1
|
3ce7e2a29f
|
[sgl-router] Render chat prompts with dynamo-render (#38983)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-17 15:57:20 +08:00 |
|
|
Kan Wu
|
279339f113
|
[sgl-router] Share model-file discovery for chat formatters (#39485)
|
2026-09-16 09:36:11 -07:00 |
|
|
Kan WuandClaude Fable 5.1
|
ad94978adf
|
[sgl-router] Rename chat encoder to chat formatter (#39459)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-16 08:46:11 -07:00 |
|
|
Kan WuandClaude Fable 5.1
|
e41026f434
|
[sgl-router] Forward input_ids only for string content; count tokenize errors only when forwardable (#39458)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-16 22:49:41 +08:00 |
|
|
Kan WuandClaude Fable 5.1
|
e89d8facab
|
[sgl-router] Prepare dynamo-render dependencies (#39457)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-14 19:08:16 -07:00 |
|
|
Kan Wu
|
07e1918924
|
[Rust] Use Dynamo native renderers when chat templates are missing (#38939)
|
2026-09-14 17:29:10 -07:00 |
|
|
Kan Wu
|
f539c1fc65
|
[sgl-router] Stream outcome observability for 2xx SSE streams (#38737)
|
2026-09-13 19:46:44 -07:00 |
|
|
Kan WuandClaude Fable 5
|
6f481ad0e3
|
[router] Raise chat body cap to 32 MB for multimodal payloads (#38735)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-09 22:14:49 -07:00 |
|
|
|
12735c2d76
|
[mm] refactor mm code for rust tokenizer manager (#34660)
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-04 03:03:25 -07:00 |
|
|
Rain Jiang
|
ba23846ccf
|
move the PD bootstrap registry under api_server::disaggregation (#33895)
|
2026-08-13 02:13:43 -07:00 |
|
|
Rain Jiang
|
fd1e04d952
|
refactor error responses into shared utils::response helpers (#33894)
|
2026-08-13 01:30:29 -07:00 |
|
|
|
32e5d788bd
|
[mm] rust-server: native multimodal processing for Qwen VL (integrate sglang-mm, e2e) (#32365)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-05 23:35:50 -07:00 |
|
|
|
26a542722f
|
[CI] Replace the rust-ext-build venv instead of failing when it exists (#33512)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-08-04 01:56:16 -07:00 |
|
|
Kan WuandClaude Fable 5
|
17d19081d9
|
[mm] sglang-mm: server vision pipeline core (fetch/driver/pipeline) + Qwen VL (#32364)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-04 00:47:00 -07:00 |
|
|
Kan WuandClaude Fable 5
|
8186eeb939
|
[rust-server] Reland: fix TCP-layer TTFT stalls (#33026) (#33269)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-02 20:52:29 -07:00 |
|
|
|
5d2dbb35a6
|
[rust-server] PD disaggregation support (#33125)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
|
2026-08-02 18:32:59 -07:00 |
|
|
Kan Wu
|
06554515f4
|
Revert "[rust-server] fix TCP-layer TTFT stalls" (#33257)
|
2026-08-02 01:20:11 -07:00 |
|
|
|
574ead753a
|
[rust-server] fix TCP-layer TTFT stalls (#33026)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-08-01 12:13:13 -07:00 |
|