Shuwen Wang
|
80263b5580
|
[Fix] sgl-router: Do not abort forwarded requests on reqwest's default 30 s TCP_USER_TIMEOUT (#45696)
|
2026-10-22 12:43:54 +08:00 |
|
Shangming Cai
|
43a3f956cb
|
[Fix] sgl-router: Wait for the detached PD prefill in routing tests (#45502)
|
2026-10-21 19:04:26 +08:00 |
|
Shangming Cai
|
cd61db49c7
|
[Fix] sgl-router: Bump rustls-webpki and webpki-roots for emSign advisories (#45526)
|
2026-10-21 15:24:11 +08:00 |
|
 Kan WuandClaude Opus 5.5
|
aba892fbdf
|
[Refactor] sgl-router: Move experimental/sgl-router to top-level sgl-router (#45414)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-21 11:09:13 +08:00 |
|
Simo Lin
|
49dfa1d891
|
[model-gateway] change sgl-router to sgl-model-gateway (#14312)
|
2025-12-05 12:04:48 -08:00 |
|
Wenyi Xu
|
1ea6b740a7
|
[model-gateway] Make Tokenizer Builder Aware of Env Vars Like HF_ENDPOINT (#14405)
|
2025-12-05 10:42:06 -08:00 |
|
fzyzcjy
|
e73173b0d7
|
Fix removing worker will make it healthy forever in prometheus metrics (#14420)
|
2025-12-05 10:40:42 -08:00 |
|
Simo Lin
|
cf9a774cf8
|
[model-gateway] fix server info comment (#14508)
|
2025-12-05 10:09:58 -08:00 |
|
 Simo Linandkey4ng
|
1569fc7f49
|
[model-gateway] reorganized conversation handler (#14507)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-05 09:31:27 -08:00 |
|
Tony Lu
|
5a46fb153d
|
[model-gateway] Add WASM support for middleware (#12471)
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
|
2025-12-05 09:29:07 -08:00 |
|
 Simo Linandkey4ng
|
05284378d6
|
[model-gateway] move conversation to first class routing (#14506)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-05 08:44:13 -08:00 |
|
Simo Lin
|
7235a7fbe9
|
[misc] add model arch and type to server info and use it for harmony (#14456)
|
2025-12-05 06:51:00 -08:00 |
|
 Simo LinandChang Su
|
c1006fd8a1
|
[model-gateway] grpc to leverage event type (#14450)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-04 14:30:19 -08:00 |
|
 Simo LinandChang Su
|
29c6c2ea9d
|
[model-gateway] add mistral 3 image processor (#14445)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-04 13:16:04 -08:00 |
|
 Simo Linandkey4ng
|
eb85fa6daf
|
[model-gateway] move all responses api event from oai to proto (#14446)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 13:11:03 -08:00 |
|
 Simo Linandkey4ng
|
d8faf2f361
|
[model-gateway] move oai header util to router header util (#14441)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 11:02:50 -08:00 |
|
 Simo Linandkey4ng
|
7f3308bc68
|
[model-gateway] extract conversation out of oai router (#14440)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 10:16:14 -08:00 |
|
Simo Lin
|
fdc2ef58db
|
[model-gateway] add llama4 vision image processor (#14438)
|
2025-12-04 09:52:36 -08:00 |
|
 Simo Linandkey4ng
|
b01fc161eb
|
[model-gateway] introduce request ctx for oai router (#14434)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 08:31:44 -08:00 |
|
Simo Lin
|
11d33c0e8f
|
[model-gateway] add phi4 vision image processor (#14430)
|
2025-12-04 07:40:33 -08:00 |
|
 
|
8428078436
|
Add Mistral Large 3 support. (#14213)
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-04 20:00:05 +08:00 |
|
Simo Lin
|
fa78c44a3d
|
[model-gateway] introduce provider in openai router (#14394)
|
2025-12-03 22:47:20 -08:00 |
|
Simo Lin
|
654a78f9c8
|
[model-gateway] add phi3 vision image processor (#14381)
|
2025-12-03 22:32:40 -08:00 |
|
Wenyi Xu
|
78647e08dd
|
[model-gateway][doc] Add STDIO Explicitly to Example in README (#14393)
|
2025-12-03 20:36:44 -08:00 |
|
fzyzcjy
|
df026bb110
|
Fix sgl-router silently parse selector wrongly causing OME fail to discover pods (#14359)
|
2025-12-04 09:56:37 +08:00 |
|
Simo Lin
|
d42c167bfd
|
[model-gateway] add qwen3_vl model image processor (#14377)
|
2025-12-03 17:16:37 -08:00 |
|
Simo Lin
|
388151053d
|
[model-gateway] use worker crate in openai router (#14330)
|
2025-12-03 13:36:32 -08:00 |
|
Simo Lin
|
8ab5d8b40d
|
[model-gateway] add qwen2.5_vl model image processor (#14375)
|
2025-12-03 12:51:30 -08:00 |
|
Simo Lin
|
03575ce38d
|
[model-gateway] add qwen2_vl model image processor and tests (#14374)
|
2025-12-03 12:34:06 -08:00 |
|
Simo Lin
|
abf6272bdd
|
[model-gateway] add llava model image processor and tests (#14371)
|
2025-12-03 11:18:00 -08:00 |
|
Simo Lin
|
58ac3f317b
|
[model-gateway] add image processor and transformer structure (#14344)
|
2025-12-03 00:04:06 -08:00 |
|
Simo Lin
|
d5ea8c7176
|
[model-gateway] multimodality initialization (#13350)
|
2025-12-02 19:41:40 -08:00 |
|
Simo Lin
|
5dad1ff1b6
|
[model-gateway] add workflow for external model providers (#14323)
|
2025-12-02 16:47:06 -08:00 |
|
Simo Lin
|
51a86ce69e
|
[model-gateway] change rust package name to sgl-model-gateway instead (#14283)
|
2025-12-02 00:06:54 -08:00 |
|
Simo Lin
|
383689e3ad
|
[model-gateway] fix version output (#14276)
|
2025-12-01 22:51:57 -08:00 |
|
Simo Lin
|
73df525382
|
[model-gateway] include smg version command in py binding (#14274)
|
2025-12-01 21:21:02 -08:00 |
|
Simo Lin
|
cd4151abc7
|
[model-gateway] add audio and moderation in model card (#14263)
|
2025-12-01 18:36:38 -08:00 |
|
 Xinyue ZhangandSimo Lin
|
1d66a14c2e
|
[model-gateway] Add e2e tests of streaming events and tool choice for response api (#13880)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-12-01 15:27:12 -08:00 |
|
Simo Lin
|
57f933fd7d
|
[model-gateway] Migrate Worker trait to model-aware methods (#14250)
|
2025-12-01 14:32:09 -08:00 |
|
Simo Lin
|
e7d6027e4a
|
[model-gateway] add ModelCard support to WorkerMetadata (#14243)
|
2025-12-01 13:04:09 -08:00 |
|
Simo Lin
|
9325f94534
|
[model-gateway] add ModelCard and ProviderType for model configuration (#14237)
|
2025-12-01 09:47:51 -08:00 |
|
Simo Lin
|
92ca629582
|
[model-gateway] add ModelType bitflags and Endpoint enum for worker (#14230)
|
2025-12-01 08:14:44 -08:00 |
|
 Chang SuandSimo Lin
|
ec92d7f14e
|
[model-gateway] fix v1/models response format to be oai compatible (#13693)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-12-01 07:20:38 -08:00 |
|
Simo Lin
|
79b389da6b
|
[model-gateway] refactor oai router 1/n (#14228)
|
2025-12-01 07:16:35 -08:00 |
|
Wenyi Xu
|
e55731b6e8
|
[model-gateway] Avoid logging MCP connection token (#13887)
|
2025-12-01 04:44:31 -08:00 |
|
Lianmin Zheng
|
bc3d2a85af
|
[Minor] update docs (#14212)
|
2025-12-01 02:33:58 -08:00 |
|
ooapex
|
f138ae5789
|
[model-gateway] support VL models in router (#14140)
|
2025-11-30 17:50:22 -08:00 |
|
Tony Lu
|
6bad6a3655
|
[model-gateway] Add version command support to SMG (#12558)
|
2025-11-28 12:34:19 -08:00 |
|
Simo Lin
|
e9e90460ed
|
[model-gateway] allow refill rate to be zero (#14030)
|
2025-11-26 17:15:27 -08:00 |
|
Xinyue Zhang
|
44d0a848da
|
[model-gateway] Fix flaky test_circuit_breaker_half_open_failure_reopens (#14019)
|
2025-11-26 14:52:10 -08:00 |
|