minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
18,508 Commits 2 Branches 0 Tags
c5326d28a348dfba14e908cb055ea4c8ec2a92fa
Commit Graph
131 Commits
Author SHA1 Message Date
Lianmin ZhengandJialin Ouyang f5a1434700 [HiCache] Document transfer arguments (#40239) 
Clarify the legacy host_indices argument and label Mamba test arguments,
including the current staging_tokens parameter. Executable code is unchanged.

Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
 2026-09-18 14:08:19 -07:00
Shuwen Wang 191172fa74 [Unified Tree] fix: exempt host-locked aux nodes from the sanity_check host-LRU check (#39980) 2026-09-18 15:29:29 +00:00
William Arnoldandishandhanani 0214954f26 [gRPC] Stream engine state changes (#39915) 
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
 2026-09-17 19:17:25 -07:00
Thomas Wang 6c73368c32 [AMD][DSV4] Enable hicache on deepseek-v4 fp8 unified attn (#37778) 2026-09-17 11:29:23 -07:00
inkcherryhuanglongShangming CaiHuang Long
 		1f60ddef5d [PD] Introduce runtime role switching between prefill and decode (#28403) 
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
 2026-09-18 01:45:12 +08:00
William Arnoldandishandhanani f45aad44bd [gRPC] Expose native pause status (#37488) 
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
 2026-09-16 15:16:52 -07:00
Liangsheng Yin 2f7d04da5d dsv4.1: Rust extension modules for image preprocessing, KV pool names, and PD bootstrap (#39677) 2026-09-15 18:11:48 -07:00
Lianmin Zheng b803cfa0c4 Add external multimodal processors to the Rust frontend (#39329) 2026-09-15 15:38:47 -07:00
Zhiqiang Xie 7f5dd19256 [HiCache] Rework the buffer-mode storage prefetch pipeline and retry bookkeeping (#39283) 2026-09-15 10:48:49 -07:00
Yuxuan ZhangandXinyuan Tong 17ba2c2e7c Support non-strict GLM47 tool calls with EBNF constraints (#38890) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-09-15 16:41:48 +08:00
ishandhanani 3f871a246c feat(agent sessions): attribute stored KV cache blocks to sessions (#37482) 
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
 2026-09-14 21:34:49 -07:00
Kan Wu 07e1918924 [Rust] Use Dynamo native renderers when chat templates are missing (#38939) 2026-09-14 17:29:10 -07:00
Shuwen WangandClaude Opus 5 7f1f8c706a [mem_cache][10/N] refactor: drop the redundant _component suffix in unified_cache/components (#35644) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-13 21:38:20 +08:00
Jundong LiuandShuwen Wang 7078e5ffbc [HiCache] Publish a host store event for storage-prefetch refills (#38486) 
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
 2026-09-13 10:29:14 +00:00
Shuwen Wang bd45cd50ca [Unified Tree] Port SWA Branching-Point Caching to the Rust TreeCore (#37584) 2026-09-12 18:37:57 +08:00
Yanbin JiangandShuwen Wang 0b415fa573 [HiCache][LoRA] Isolate storage pages by extra key (#38577) 
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
 2026-09-12 18:18:14 +08:00
Shuwen Wang b9cb96496d [Unified Tree] Preserve aux LRU recency when splitting nodes (#38482) 2026-09-12 18:17:38 +08:00
Jialin Ouyang 908226fea2 [Rust TreeCore] Support external cache linker (#37306) 2026-09-10 19:22:24 +08:00
Po-Han Huang (NVIDIA) 51c8581a26 [Rust] Gate health on startup warmup completion (#37994) 2026-09-09 15:55:13 -07:00
Zhiqiang Xie beaf3d9252 [HiCache] Replace skip_lock_node_ids with a segment lock protocol (#36848) 2026-09-09 14:55:51 -07:00
Jialin Ouyang 7a464a7014 [Rust TreeCore] Harden runtime and CI parity (#37303) 2026-09-09 10:40:22 +08:00
Rain Jiang b83a59835d sglang-server remove opaque type (#38095) 2026-09-08 00:41:31 -07:00
Shuwen Wang 19b46863f3 fix: align write-through pending across tree cores (#37278) 2026-09-04 22:08:25 +08:00
Lianmin Zheng 978cc228ca [Rust] Bound multimodal media ingress (#37967) 2026-09-04 05:22:44 -07:00
Kan WuRain JiangCursorClaude Fable 5
 		12735c2d76 [mm] refactor mm code for rust tokenizer manager (#34660) 
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-09-04 03:03:25 -07:00
Yash AkhauriXiaoyu ZhangXinyuan Tong
 		3bac084d4e [Model] Add native IFM K2 Horizon serving support (#37654) 
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-09-03 16:39:43 +08:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210) 
Co-authored-by: Alison Shao <a.shao@wustl.edu>
 2026-09-02 19:46:08 -07:00
Xinyi Song1am9trashAMD-yanfeiwangThomas Wang
 		f8cbf000f4 [AMD] Enable FP4 indexer for Deepseek V4 (#37353) 
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: AMD-yanfeiwang <256076023+AMD-yanfeiwang@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
 2026-09-02 09:45:08 -07:00
Lianmin Zheng f8f04bafa8 Rust server: align launcher and request validation behavior (#37327) 2026-09-01 23:42:36 -07:00
Liangsheng Yin 832d029870 [mem_cache] Split duplicate insert frees at the SWA eviction floor (#37481) 2026-09-01 23:01:40 -07:00
Jialin Ouyang a77283fb02 [Rust] Rename mem-cache to sglang-radix-tree (#37290) 2026-09-01 03:03:44 -07:00
Lianmin Zheng 579270d459 [Rust] Simplify request defaults and document batch header ABI (#37226) 2026-08-31 12:31:35 -07:00
Lianmin Zheng 2138494272 [Rust] Keep sampling and scheduler wire schemas in sync (#37222) 2026-08-31 12:31:07 -07:00
Lianmin Zheng 48098b5f23 [Rust] Derive server address and accept signed env values (#37221) 2026-08-31 12:30:40 -07:00
Lianmin Zheng 1da86b9801 [Rust] Split and rename embedded server components (#37220) 2026-08-31 12:28:43 -07:00
Jialin Ouyangalphabetc1ispobock
 		9cf157c252 [Radix Cache] Add Rust TreeCore backend with shared parity tests (#32710) 
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
 2026-09-01 00:26:20 +08:00
Liangsheng YincswuygcswuygVedant JhaveriVedant Jhaveri
 		ec4bdbfa4a [Feature] Beam search support (#31626) 
Co-authored-by: cswuyg <cswuyg@gmail.com>
Co-authored-by: cswuyg <496090217@qq.com>
Co-authored-by: Vedant Jhaveri <vedantjh2@gmail.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
 2026-08-26 16:56:15 -07:00
Rain Jiang 7d7ab4b5c6 Rainj me/rust server refactor2 (#35239) 2026-08-21 16:37:02 -07:00
Lianmin Zheng 70ee6b1714 [Rust Server] Add e2e latency metadata and fix Sarashina import (#35125) 2026-08-18 02:08:07 -07:00
Cheng Wan c70c7d72a8 config: the readback and the resolving view say what they are (#35027) 2026-08-17 16:18:19 -07:00
Lianmin Zheng 67e12131df Build Rust extensions on demand in source checkouts (#34994) 2026-08-16 14:58:06 -07:00
Rain Jiang ba23846ccf move the PD bootstrap registry under api_server::disaggregation (#33895) 2026-08-13 02:13:43 -07:00
Rain Jiang fd1e04d952 refactor error responses into shared utils::response helpers (#33894) 2026-08-13 01:30:29 -07:00
Kan WuClaude Fable 5Cursor
 		32e5d788bd [mm] rust-server: native multimodal processing for Qwen VL (integrate sglang-mm, e2e) (#32365) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-08-05 23:35:50 -07:00
Connor CarpenterishandhananiAlex Nails
 		a0b04dbe4c feat(grpc): add generation request semantics (#32588) 
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
 2026-08-04 18:53:45 -07:00
Kan WuandClaude Fable 5 17d19081d9 [mm] sglang-mm: server vision pipeline core (fetch/driver/pipeline) + Qwen VL (#32364) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-04 00:47:00 -07:00
Liangsheng Yin 157401f050 [CI] Build the Rust extensions on the 5090 pool and seed the cache from main (#33460) 2026-08-03 23:33:20 -07:00
Rain Jiang 4494fb96b2 refactor the tcp listener binding logic (#33420) 2026-08-03 22:10:52 -07:00
Chengyu LinandRain Jiang e00f32ed4f feat: rust sglang server openai apis (#33103) 
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
 2026-08-02 23:13:44 -07:00
Kan WuandClaude Fable 5 8186eeb939 [rust-server] Reland: fix TCP-layer TTFT stalls (#33026) (#33269) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-02 20:52:29 -07:00