 Liangsheng Yin
|
2f7d04da5d
|
dsv4.1: Rust extension modules for image preprocessing, KV pool names, and PD bootstrap (#39677)
|
2026-09-15 18:11:48 -07:00 |
|
|
Lianmin Zheng
|
b803cfa0c4
|
Add external multimodal processors to the Rust frontend (#39329)
|
2026-09-15 15:38:47 -07:00 |
|
|
Zhiqiang Xie
|
7f5dd19256
|
[HiCache] Rework the buffer-mode storage prefetch pipeline and retry bookkeeping (#39283)
|
2026-09-15 10:48:49 -07:00 |
|
|
Yuxuan ZhangandXinyuan Tong
|
17ba2c2e7c
|
Support non-strict GLM47 tool calls with EBNF constraints (#38890)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-15 16:41:48 +08:00 |
|
|
ishandhanani
|
3f871a246c
|
feat(agent sessions): attribute stored KV cache blocks to sessions (#37482)
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-09-14 21:34:49 -07:00 |
|
|
Kan Wu
|
07e1918924
|
[Rust] Use Dynamo native renderers when chat templates are missing (#38939)
|
2026-09-14 17:29:10 -07:00 |
|
|
Shuwen WangandClaude Opus 5
|
7f1f8c706a
|
[mem_cache][10/N] refactor: drop the redundant _component suffix in unified_cache/components (#35644)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-13 21:38:20 +08:00 |
|
|
Jundong LiuandShuwen Wang
|
7078e5ffbc
|
[HiCache] Publish a host store event for storage-prefetch refills (#38486)
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-09-13 10:29:14 +00:00 |
|
|
Shuwen Wang
|
bd45cd50ca
|
[Unified Tree] Port SWA Branching-Point Caching to the Rust TreeCore (#37584)
|
2026-09-12 18:37:57 +08:00 |
|
|
Yanbin JiangandShuwen Wang
|
0b415fa573
|
[HiCache][LoRA] Isolate storage pages by extra key (#38577)
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-09-12 18:18:14 +08:00 |
|
|
Shuwen Wang
|
b9cb96496d
|
[Unified Tree] Preserve aux LRU recency when splitting nodes (#38482)
|
2026-09-12 18:17:38 +08:00 |
|
|
Jialin Ouyang
|
908226fea2
|
[Rust TreeCore] Support external cache linker (#37306)
|
2026-09-10 19:22:24 +08:00 |
|
|
Po-Han Huang (NVIDIA)
|
51c8581a26
|
[Rust] Gate health on startup warmup completion (#37994)
|
2026-09-09 15:55:13 -07:00 |
|
|
Zhiqiang Xie
|
beaf3d9252
|
[HiCache] Replace skip_lock_node_ids with a segment lock protocol (#36848)
|
2026-09-09 14:55:51 -07:00 |
|
|
Jialin Ouyang
|
7a464a7014
|
[Rust TreeCore] Harden runtime and CI parity (#37303)
|
2026-09-09 10:40:22 +08:00 |
|
|
Rain Jiang
|
b83a59835d
|
sglang-server remove opaque type (#38095)
|
2026-09-08 00:41:31 -07:00 |
|
|
Shuwen Wang
|
19b46863f3
|
fix: align write-through pending across tree cores (#37278)
|
2026-09-04 22:08:25 +08:00 |
|
|
Lianmin Zheng
|
978cc228ca
|
[Rust] Bound multimodal media ingress (#37967)
|
2026-09-04 05:22:44 -07:00 |
|
|
|
12735c2d76
|
[mm] refactor mm code for rust tokenizer manager (#34660)
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-04 03:03:25 -07:00 |
|
|
|
3bac084d4e
|
[Model] Add native IFM K2 Horizon serving support (#37654)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-03 16:39:43 +08:00 |
|
|
Alex NailsandAlison Shao
|
28262c20df
|
[CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
|
2026-09-02 19:46:08 -07:00 |
|
|
|
f8cbf000f4
|
[AMD] Enable FP4 indexer for Deepseek V4 (#37353)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: AMD-yanfeiwang <256076023+AMD-yanfeiwang@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-09-02 09:45:08 -07:00 |
|
|
Lianmin Zheng
|
f8f04bafa8
|
Rust server: align launcher and request validation behavior (#37327)
|
2026-09-01 23:42:36 -07:00 |
|
|
Liangsheng Yin
|
832d029870
|
[mem_cache] Split duplicate insert frees at the SWA eviction floor (#37481)
|
2026-09-01 23:01:40 -07:00 |
|
|
Jialin Ouyang
|
a77283fb02
|
[Rust] Rename mem-cache to sglang-radix-tree (#37290)
|
2026-09-01 03:03:44 -07:00 |
|
|
Lianmin Zheng
|
579270d459
|
[Rust] Simplify request defaults and document batch header ABI (#37226)
|
2026-08-31 12:31:35 -07:00 |
|
|
Lianmin Zheng
|
2138494272
|
[Rust] Keep sampling and scheduler wire schemas in sync (#37222)
|
2026-08-31 12:31:07 -07:00 |
|
|
Lianmin Zheng
|
48098b5f23
|
[Rust] Derive server address and accept signed env values (#37221)
|
2026-08-31 12:30:40 -07:00 |
|
|
Lianmin Zheng
|
1da86b9801
|
[Rust] Split and rename embedded server components (#37220)
|
2026-08-31 12:28:43 -07:00 |
|
|
|
9cf157c252
|
[Radix Cache] Add Rust TreeCore backend with shared parity tests (#32710)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-09-01 00:26:20 +08:00 |
|
|
|
ec4bdbfa4a
|
[Feature] Beam search support (#31626)
Co-authored-by: cswuyg <cswuyg@gmail.com>
Co-authored-by: cswuyg <496090217@qq.com>
Co-authored-by: Vedant Jhaveri <vedantjh2@gmail.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
|
2026-08-26 16:56:15 -07:00 |
|
|
Rain Jiang
|
7d7ab4b5c6
|
Rainj me/rust server refactor2 (#35239)
|
2026-08-21 16:37:02 -07:00 |
|
|
Lianmin Zheng
|
70ee6b1714
|
[Rust Server] Add e2e latency metadata and fix Sarashina import (#35125)
|
2026-08-18 02:08:07 -07:00 |
|
|
Cheng Wan
|
c70c7d72a8
|
config: the readback and the resolving view say what they are (#35027)
|
2026-08-17 16:18:19 -07:00 |
|
|
Lianmin Zheng
|
67e12131df
|
Build Rust extensions on demand in source checkouts (#34994)
|
2026-08-16 14:58:06 -07:00 |
|
|
Rain Jiang
|
ba23846ccf
|
move the PD bootstrap registry under api_server::disaggregation (#33895)
|
2026-08-13 02:13:43 -07:00 |
|
|
Rain Jiang
|
fd1e04d952
|
refactor error responses into shared utils::response helpers (#33894)
|
2026-08-13 01:30:29 -07:00 |
|
|
|
32e5d788bd
|
[mm] rust-server: native multimodal processing for Qwen VL (integrate sglang-mm, e2e) (#32365)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-05 23:35:50 -07:00 |
|
|
|
a0b04dbe4c
|
feat(grpc): add generation request semantics (#32588)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-04 18:53:45 -07:00 |
|
|
Kan WuandClaude Fable 5
|
17d19081d9
|
[mm] sglang-mm: server vision pipeline core (fetch/driver/pipeline) + Qwen VL (#32364)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-04 00:47:00 -07:00 |
|
|
Liangsheng Yin
|
157401f050
|
[CI] Build the Rust extensions on the 5090 pool and seed the cache from main (#33460)
|
2026-08-03 23:33:20 -07:00 |
|
|
Rain Jiang
|
4494fb96b2
|
refactor the tcp listener binding logic (#33420)
|
2026-08-03 22:10:52 -07:00 |
|
|
Chengyu LinandRain Jiang
|
e00f32ed4f
|
feat: rust sglang server openai apis (#33103)
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
|
2026-08-02 23:13:44 -07:00 |
|
|
Kan WuandClaude Fable 5
|
8186eeb939
|
[rust-server] Reland: fix TCP-layer TTFT stalls (#33026) (#33269)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-02 20:52:29 -07:00 |
|
|
|
5d2dbb35a6
|
[rust-server] PD disaggregation support (#33125)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
|
2026-08-02 18:32:59 -07:00 |
|
|
Kan Wu
|
06554515f4
|
Revert "[rust-server] fix TCP-layer TTFT stalls" (#33257)
|
2026-08-02 01:20:11 -07:00 |
|
|
|
574ead753a
|
[rust-server] fix TCP-layer TTFT stalls (#33026)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-08-01 12:13:13 -07:00 |
|
|
Rain Jiang
|
1d640aaea2
|
bump dynamo-tokenizers to 1.7.0 (#32981)
|
2026-07-31 15:02:28 -07:00 |
|
|
Rain JiangandAlex Nails
|
9dcaf6bfdf
|
rust server build release artifacts (#33096)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-31 12:36:25 -07:00 |
|
|
Rain Jiang
|
4af8ddb576
|
support rust sglang server (#29799)
|
2026-07-31 11:56:31 -07:00 |
|