Commit Graph
24 Commits
Author SHA1 Message Date
Rain Jiang 12dc623102 [Chore] rust: Remove the sglang-renderer crate (#43451) 2026-10-14 11:43:37 -07:00
Rain Jiang e98c6d7b25 Rainj me/rust bench (#43950) 2026-10-13 11:07:42 -07:00
49e629d239 [Rust] Upgrade sglang-radix-tree to PyO3 0.29 (#42807)
Co-authored-by: colleen-tml <296620403+colleen-tml@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 20:56:50 +08:00
Rain Jiang c52dcc5a01 The sgalng api specs (#41585) 2026-10-07 01:55:01 -07:00
Sage 8e4bcc5ca9 [rust-renderer] sglang-processor lib (#41896)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-09-30 15:09:35 -07:00
jain-ria 21ed9fbf44 [Rust] Extract shared runtime.v1 protobuf bindings (#41726)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
2026-09-30 10:13:08 -07:00
7b1c2ed0a4 [rust-renderer] Standalone preprocessing (#36718)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
2026-09-20 22:03:12 +08:00
Jialin Ouyang a77283fb02 [Rust] Rename mem-cache to sglang-radix-tree (#37290) 2026-09-01 03:03:44 -07:00
9cf157c252 [Radix Cache] Add Rust TreeCore backend with shared parity tests (#32710)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
2026-09-01 00:26:20 +08:00
Kan WuandClaude Fable 5 8186eeb939 [rust-server] Reland: fix TCP-layer TTFT stalls (#33026) (#33269)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-02 20:52:29 -07:00
Rain Jiang 20eb37a2a1 init sglang rust server project (#32256) 2026-07-23 21:47:15 +00:00
Rain Jiang 7fe82dd02e create rust workspace (#32014) 2026-07-23 12:02:41 -07:00
Ata Fatahi e3b3acfa6f Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-12 09:40:41 -08:00
Byron Hsu 864bf2ba00 [router] remove main.rs because only lib.rs is used for py binding (#2453) 2024-12-11 12:13:19 -08:00
Byron Hsu 6387098f5f [router] add health checking in router init (#2393) 2024-12-08 17:17:37 -08:00
Byron Hsu ef995dae1e [router] Health check on worker before adding to the router (#2392) 2024-12-07 15:39:54 -08:00
Byron Hsu 4d62bca542 [router] Replace print with logger (#2183) 2024-11-25 13:36:02 -08:00
Byron Hsu cbedd1db1d [router] cache-aware load-balancing router v1 (#2114) 2024-11-23 08:34:48 -08:00
Tzu Gwo df246e699d chore: open lto and optimization in release profile (#2028) 2024-11-14 15:02:39 +08:00
Byron Hsu 00ffde206f setup router python binding ci (#1999) 2024-11-11 12:19:32 -08:00
Byron Hsu f9633fa9b9 [rust] cache-aware DP - approx tree (#1934) 2024-11-10 21:57:32 -08:00
Xuehai Pan a5e0defb5a minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) 2024-11-06 13:46:04 +00:00
Byron HsuandLianmin Zheng 530ff541cf [router] Impl radix tree and set up CI (#1893)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2024-11-04 10:56:52 -08:00
Byron Hsu 3839be2913 [Router] Add a rust-based router (#1790) 2024-10-28 09:49:48 -07:00