|
3bac084d4e
|
[Model] Add native IFM K2 Horizon serving support (#37654)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-03 16:39:43 +08:00 |
|
|
Alex NailsandAlison Shao
|
28262c20df
|
[CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
|
2026-09-02 19:46:08 -07:00 |
|
|
|
f8cbf000f4
|
[AMD] Enable FP4 indexer for Deepseek V4 (#37353)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: AMD-yanfeiwang <256076023+AMD-yanfeiwang@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-09-02 09:45:08 -07:00 |
|
|
Lianmin Zheng
|
f8f04bafa8
|
Rust server: align launcher and request validation behavior (#37327)
|
2026-09-01 23:42:36 -07:00 |
|
|
Liangsheng Yin
|
832d029870
|
[mem_cache] Split duplicate insert frees at the SWA eviction floor (#37481)
|
2026-09-01 23:01:40 -07:00 |
|
|
Jialin Ouyang
|
a77283fb02
|
[Rust] Rename mem-cache to sglang-radix-tree (#37290)
|
2026-09-01 03:03:44 -07:00 |
|
|
Lianmin Zheng
|
579270d459
|
[Rust] Simplify request defaults and document batch header ABI (#37226)
|
2026-08-31 12:31:35 -07:00 |
|
|
Lianmin Zheng
|
2138494272
|
[Rust] Keep sampling and scheduler wire schemas in sync (#37222)
|
2026-08-31 12:31:07 -07:00 |
|
|
Lianmin Zheng
|
48098b5f23
|
[Rust] Derive server address and accept signed env values (#37221)
|
2026-08-31 12:30:40 -07:00 |
|
|
Lianmin Zheng
|
1da86b9801
|
[Rust] Split and rename embedded server components (#37220)
|
2026-08-31 12:28:43 -07:00 |
|
|
|
9cf157c252
|
[Radix Cache] Add Rust TreeCore backend with shared parity tests (#32710)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-09-01 00:26:20 +08:00 |
|
|
|
ec4bdbfa4a
|
[Feature] Beam search support (#31626)
Co-authored-by: cswuyg <cswuyg@gmail.com>
Co-authored-by: cswuyg <496090217@qq.com>
Co-authored-by: Vedant Jhaveri <vedantjh2@gmail.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
|
2026-08-26 16:56:15 -07:00 |
|
|
Rain Jiang
|
7d7ab4b5c6
|
Rainj me/rust server refactor2 (#35239)
|
2026-08-21 16:37:02 -07:00 |
|
|
Lianmin Zheng
|
70ee6b1714
|
[Rust Server] Add e2e latency metadata and fix Sarashina import (#35125)
|
2026-08-18 02:08:07 -07:00 |
|
|
Cheng Wan
|
c70c7d72a8
|
config: the readback and the resolving view say what they are (#35027)
|
2026-08-17 16:18:19 -07:00 |
|
|
Lianmin Zheng
|
67e12131df
|
Build Rust extensions on demand in source checkouts (#34994)
|
2026-08-16 14:58:06 -07:00 |
|
|
Rain Jiang
|
ba23846ccf
|
move the PD bootstrap registry under api_server::disaggregation (#33895)
|
2026-08-13 02:13:43 -07:00 |
|
|
Rain Jiang
|
fd1e04d952
|
refactor error responses into shared utils::response helpers (#33894)
|
2026-08-13 01:30:29 -07:00 |
|
|
|
32e5d788bd
|
[mm] rust-server: native multimodal processing for Qwen VL (integrate sglang-mm, e2e) (#32365)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-05 23:35:50 -07:00 |
|
|
|
a0b04dbe4c
|
feat(grpc): add generation request semantics (#32588)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-04 18:53:45 -07:00 |
|
|
Kan WuandClaude Fable 5
|
17d19081d9
|
[mm] sglang-mm: server vision pipeline core (fetch/driver/pipeline) + Qwen VL (#32364)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-04 00:47:00 -07:00 |
|
|
Liangsheng Yin
|
157401f050
|
[CI] Build the Rust extensions on the 5090 pool and seed the cache from main (#33460)
|
2026-08-03 23:33:20 -07:00 |
|
|
Rain Jiang
|
4494fb96b2
|
refactor the tcp listener binding logic (#33420)
|
2026-08-03 22:10:52 -07:00 |
|
|
Chengyu LinandRain Jiang
|
e00f32ed4f
|
feat: rust sglang server openai apis (#33103)
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
|
2026-08-02 23:13:44 -07:00 |
|
|
Kan WuandClaude Fable 5
|
8186eeb939
|
[rust-server] Reland: fix TCP-layer TTFT stalls (#33026) (#33269)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-02 20:52:29 -07:00 |
|
|
|
5d2dbb35a6
|
[rust-server] PD disaggregation support (#33125)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
|
2026-08-02 18:32:59 -07:00 |
|
|
Kan Wu
|
06554515f4
|
Revert "[rust-server] fix TCP-layer TTFT stalls" (#33257)
|
2026-08-02 01:20:11 -07:00 |
|
|
|
574ead753a
|
[rust-server] fix TCP-layer TTFT stalls (#33026)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-08-01 12:13:13 -07:00 |
|
|
Rain Jiang
|
1d640aaea2
|
bump dynamo-tokenizers to 1.7.0 (#32981)
|
2026-07-31 15:02:28 -07:00 |
|
|
Rain JiangandAlex Nails
|
9dcaf6bfdf
|
rust server build release artifacts (#33096)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-31 12:36:25 -07:00 |
|
|
Rain Jiang
|
4af8ddb576
|
support rust sglang server (#29799)
|
2026-07-31 11:56:31 -07:00 |
|
|
Rain Jiang
|
3312645a30
|
wire the rust server modules into lib, runtime, and tokenizer manager (#32877)
|
2026-07-30 12:46:19 -07:00 |
|
|
Rain Jiang
|
047635ee35
|
add the rust server native api handlers and runtime threads (#32876)
|
2026-07-30 12:46:19 -07:00 |
|
|
Rain Jiang
|
30643f88bc
|
add the rust server api frame codec and http server entry (#32875)
|
2026-07-30 12:46:19 -07:00 |
|
|
Rain Jiang
|
4facc0e18a
|
add the rust server ingress tests, guard, and submit modules (#32874)
|
2026-07-30 12:46:18 -07:00 |
|
|
Rain Jiang
|
e2c65af229
|
add the rust server ingress request validation and api server common types (#32873)
|
2026-07-30 12:46:17 -07:00 |
|
|
Rain Jiang
|
922d6e5542
|
add the rust server tokenizer, detokenizer, and egress modules (#32872)
|
2026-07-30 12:46:17 -07:00 |
|
|
Rain Jiang
|
35f2e6ab58
|
update Cargo.lock for the rust sglang-server dependencies (#32871)
|
2026-07-30 12:32:27 -07:00 |
|
|
Rain Jiang
|
d7a4c830e5
|
sglang rust server tokenizer manager, ring and runtime (#32358)
|
2026-07-29 18:42:12 -07:00 |
|
|
Rain Jiang
|
6e48c13497
|
sglang rust server egress message (#32342)
|
2026-07-29 17:16:06 -07:00 |
|
|
Rain Jiang
|
d24de56995
|
sglang rust server sampling message (#32343)
|
2026-07-29 14:55:06 -07:00 |
|
|
Rain Jiang
|
2ca2ca753a
|
sglang rust server request message (#32242)
|
2026-07-29 10:54:56 -07:00 |
|
|
Rain Jiang
|
d943636a48
|
support regex that compatible with python re lib however apply more l… (#32676)
|
2026-07-28 14:25:31 -07:00 |
|
|
Rain Jiang
|
be7cc17307
|
sglang rust server environ fsm error id gen (#32240)
|
2026-07-24 20:55:10 +00:00 |
|
|
Rain Jiang
|
20eb37a2a1
|
init sglang rust server project (#32256)
|
2026-07-23 21:47:15 +00:00 |
|
|
Rain Jiang
|
7fe82dd02e
|
create rust workspace (#32014)
|
2026-07-23 12:02:41 -07:00 |
|
|
|
02236fa38c
|
Add Inkling model support (#31681)
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Qiaolin Yu <qiaolin.yu@radixark.ai>
Co-authored-by: Zhichen Zeng <zczeng@uw.edu>
Co-authored-by: Aurick Qiao <aurick@thinkingmachines.ai>
Co-authored-by: Joseph <jk@thinkingmachines.ai>
|
2026-07-19 22:57:37 -07:00 |
|
|
Connor CarpenterandIshan Dhanani
|
cc7d6659fd
|
feat(grpc): support disaggregated generation requests (#30440)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-07-08 14:53:56 -07:00 |
|
|
ishandhanani
|
aaa31eb0a1
|
feat: first-class session identity in SGLang (#29436)
|
2026-06-28 07:16:38 -07:00 |
|
|
Alex Nails
|
1d19721394
|
[gRPC] Native server: Rust crate (1/N) (#23506)
|
2026-05-18 22:31:38 -07:00 |
|