Commit Graph
20 Commits
Author SHA1 Message Date
26a2f18c02 [Feat] sglang-server: serve /v1/loads from the Rust frontend (#44532)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
2026-10-16 10:35:37 -07:00
9732188a58 [Rust] Serve /weights_checker from the Rust frontend (#43926)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
2026-10-14 16:41:10 -07:00
Kan WuandClaude Opus 5.5 4560da58ee [sgl-router] Render GLM-5.3 and GLM-5.3-Flash through sglang-processor (#43625)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 13:19:44 +08:00
3ba90f1b52 [rust] Update Dynamo frontend crates to latest compatible releases (#42666)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 11:46:01 +08:00
Rain Jiang c52dcc5a01 The sgalng api specs (#41585) 2026-10-07 01:55:01 -07:00
jain-ria fb92ba1127 [Rust] Wire the gRPC server into the frontend lifecycle (#41964)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
2026-10-01 10:44:56 -07:00
jain-ria ebccddce19 [Rust] Implement the Rust gRPC adapter for native generation (#41766)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
2026-09-30 18:17:42 -07:00
Rain Jiang 6c4f36e47a Rust server unify datapath for mm and generate requests (#39679) 2026-09-27 23:36:07 -07:00
Kan Wu 07e1918924 [Rust] Use Dynamo native renderers when chat templates are missing (#38939) 2026-09-14 17:29:10 -07:00
Lianmin Zheng 1da86b9801 [Rust] Split and rename embedded server components (#37220) 2026-08-31 12:28:43 -07:00
Lianmin Zheng 67e12131df Build Rust extensions on demand in source checkouts (#34994) 2026-08-16 14:58:06 -07:00
Rain Jiang ba23846ccf move the PD bootstrap registry under api_server::disaggregation (#33895) 2026-08-13 02:13:43 -07:00
32e5d788bd [mm] rust-server: native multimodal processing for Qwen VL (integrate sglang-mm, e2e) (#32365)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 23:35:50 -07:00
Chengyu LinandRain Jiang e00f32ed4f feat: rust sglang server openai apis (#33103)
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
2026-08-02 23:13:44 -07:00
Kan WuandClaude Fable 5 8186eeb939 [rust-server] Reland: fix TCP-layer TTFT stalls (#33026) (#33269)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-02 20:52:29 -07:00
Rain Jiang 1d640aaea2 bump dynamo-tokenizers to 1.7.0 (#32981) 2026-07-31 15:02:28 -07:00
Rain JiangandAlex Nails 9dcaf6bfdf rust server build release artifacts (#33096)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-07-31 12:36:25 -07:00
Rain Jiang 4af8ddb576 support rust sglang server (#29799) 2026-07-31 11:56:31 -07:00
Rain Jiang d943636a48 support regex that compatible with python re lib however apply more l… (#32676) 2026-07-28 14:25:31 -07:00
Rain Jiang 20eb37a2a1 init sglang rust server project (#32256) 2026-07-23 21:47:15 +00:00