Commit Graph
19 Commits
Author SHA1 Message Date
7b1c2ed0a4 [rust-renderer] Standalone preprocessing (#36718)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
2026-09-20 22:03:12 +08:00
Kan Wu 07e1918924 [Rust] Use Dynamo native renderers when chat templates are missing (#38939) 2026-09-14 17:29:10 -07:00
Lianmin Zheng 67e12131df Build Rust extensions on demand in source checkouts (#34994) 2026-08-16 14:58:06 -07:00
Rain Jiang ba23846ccf move the PD bootstrap registry under api_server::disaggregation (#33895) 2026-08-13 02:13:43 -07:00
32e5d788bd [mm] rust-server: native multimodal processing for Qwen VL (integrate sglang-mm, e2e) (#32365)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 23:35:50 -07:00
Kan WuandClaude Fable 5 17d19081d9 [mm] sglang-mm: server vision pipeline core (fetch/driver/pipeline) + Qwen VL (#32364)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-04 00:47:00 -07:00
Chengyu LinandRain Jiang e00f32ed4f feat: rust sglang server openai apis (#33103)
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
2026-08-02 23:13:44 -07:00
Kan WuandClaude Fable 5 8186eeb939 [rust-server] Reland: fix TCP-layer TTFT stalls (#33026) (#33269)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-02 20:52:29 -07:00
Rain Jiang 1d640aaea2 bump dynamo-tokenizers to 1.7.0 (#32981) 2026-07-31 15:02:28 -07:00
Ata Fatahi e3b3acfa6f Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-12 09:40:41 -08:00
Byron Hsu 6387098f5f [router] add health checking in router init (#2393) 2024-12-08 17:17:37 -08:00
Byron Hsu ef995dae1e [router] Health check on worker before adding to the router (#2392) 2024-12-07 15:39:54 -08:00
Byron Hsu 4d62bca542 [router] Replace print with logger (#2183) 2024-11-25 13:36:02 -08:00
dependabot[bot] 5ada33ffa0 Bump rustls from 0.23.16 to 0.23.18 in /rust (#2182)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-26 03:22:33 +08:00
Byron Hsu cbedd1db1d [router] cache-aware load-balancing router v1 (#2114) 2024-11-23 08:34:48 -08:00
Byron Hsu 00ffde206f setup router python binding ci (#1999) 2024-11-11 12:19:32 -08:00
Byron Hsu f9633fa9b9 [rust] cache-aware DP - approx tree (#1934) 2024-11-10 21:57:32 -08:00
Byron HsuandLianmin Zheng 530ff541cf [router] Impl radix tree and set up CI (#1893)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2024-11-04 10:56:52 -08:00
Byron Hsu 3839be2913 [Router] Add a rust-based router (#1790) 2024-10-28 09:49:48 -07:00