 
|
209f8220d6
|
[Fix] sglang-server: Honour extra_key on the Rust frontend's /generate (#44207)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:44:31 -07:00 |
|
  
|
e7d6a88bfc
|
[HiCache] Buffer-only L3 for an auxiliary SWA window; load back only missing window rows (#43932)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: houseroad <houseroad@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-14 16:43:24 -07:00 |
|
 
|
aa8793f33b
|
[Rust] Serve scheduler metrics on the Rust frontend's /metrics (#43942)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:43:06 -07:00 |
|
 
|
9732188a58
|
[Rust] Serve /weights_checker from the Rust frontend (#43926)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:41:10 -07:00 |
|
Rain Jiang
|
12dc623102
|
[Chore] rust: Remove the sglang-renderer crate (#43451)
|
2026-10-14 11:43:37 -07:00 |
|
  
|
010776e94f
|
[KV events] Publish opaque LoRA block IDs and adapter names (#42817)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 22:56:28 +08:00 |
|
 
|
204644c2dc
|
[Fix] sglang-processor: Follow Python's OpenAI layer through #43027, #37577, #43006, #43026, #43005 (#44243)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 21:06:13 +08:00 |
|
 
|
817781b828
|
[Feat] sgl-router: Render Qwen3.8 (Max, 27B, Flash-Next) through sglang-processor (#43689)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 17:09:35 +08:00 |
|
 Kan WuandClaude Opus 5.5
|
53a24c448e
|
[Feat] sgl-router: Render Kimi-K3 through sglang-processor (#43608)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 23:40:18 -07:00 |
|
 Kan WuandClaude Opus 5.5
|
4560da58ee
|
[sgl-router] Render GLM-5.3 and GLM-5.3-Flash through sglang-processor (#43625)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:19:44 +08:00 |
|
 HEJIAN SANGandClaude Opus 5.5
|
a832609b92
|
[Feature] Return output top logprobs as flat base64 arrays on request (#42890)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 15:58:31 -07:00 |
|
 
|
79af3df346
|
[gRPC] Move runtime.v1 bindings to tonic 0.14, report OpenAI status codes, return text on request (#42673)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 13:46:15 -07:00 |
|
 Xinyuan TongandNihar Patel
|
7dc2930585
|
[Feature] Add Aaronson-Gumbel text watermarking (#37577)
Co-authored-by: Nihar Patel <nihpat95@gmail.com>
|
2026-10-13 12:47:50 -07:00 |
|
 
|
ce5352a814
|
[Rust] Serve any model name on the OpenAI chat and completions routes (#43923)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-13 11:58:57 -07:00 |
|
 
|
149ef7d1b7
|
[Rust] Let an embedding package wrap the frontend HTTP app (#43924)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-13 11:44:43 -07:00 |
|
Rain Jiang
|
e98c6d7b25
|
Rainj me/rust bench (#43950)
|
2026-10-13 11:07:42 -07:00 |
|
 
|
e775fa7253
|
[Build][CI] Drop Python 3.10: require Python 3.11+ and run CUDA CI on Python 3.12 (#43021)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-10-12 18:40:16 -07:00 |
|
Артем Савкин
|
d1357bf87b
|
[NPU] Diffusion CI fixes (#43210)
|
2026-10-12 14:53:51 +03:00 |
|
 
|
77a15cf4e2
|
[MemCache] Add shared component size and path APIs to the tree core interface (#43722)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-11 20:14:07 -07:00 |
|
 
|
95ce9caaf2
|
[Rust] Lock hyper 1.12.0 and want 0.3.2 in the rust workspace (#43724)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-11 20:12:55 -07:00 |
|
 Banruo LiuandShangming Cai
|
d62b9c2480
|
[KV Events] Publish LoRA adapter names and namespaced block hashes (#42455)
Signed-off-by: Banruo Liu <lichangxinlivingshade@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-11 23:23:30 +08:00 |
|
Shuwen Wang
|
99d6f4e158
|
[MemCache] refactor: require an anchored lock receipt for non-root releases (#41452)
|
2026-10-10 22:43:49 +08:00 |
|
 
|
49e629d239
|
[Rust] Upgrade sglang-radix-tree to PyO3 0.29 (#42807)
Co-authored-by: colleen-tml <296620403+colleen-tml@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 20:56:50 +08:00 |
|
Sage
|
6fc8d9da32
|
[rust-server] preserve PD routing in chat and completions (#42989)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-10 17:29:46 +08:00 |
|
 
|
f2e9a2bed1
|
[unified memory pool] Allocate without transfer waits, pin floating SWA reservations, drop the HiCache startup asserts (#43206)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: ZYHowell <ZYHowell@users.noreply.github.com>
|
2026-10-09 20:19:30 -07:00 |
|
 
|
16423cb6d2
|
[sgl-router] Serve DeepSeek-V4.1 Flash through sglang-processor (#43000)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 09:23:09 +08:00 |
|
 
|
d511e6bd1d
|
[sgl-router] Parse tool calls when serving chat through /generate (#42999)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 21:07:30 +08:00 |
|
  
|
3805d78796
|
[sgl-router] Serve /v1/chat/completions through /generate, with reasoning parsing (#42998)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-09 19:17:52 +08:00 |
|
 
|
b130f8af02
|
[sgl-router] Serve /v1/completions through /generate, with the shared OpenAI layer (#42997)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 16:04:04 +08:00 |
|
  
|
f620d733d2
|
[rust-processor] Share the reasoning splitter and tool constraint across hosts (#42996)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-09 15:19:41 +08:00 |
|
 
|
3ba90f1b52
|
[rust] Update Dynamo frontend crates to latest compatible releases (#42666)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 11:46:01 +08:00 |
|
shodoco
|
86624f14eb
|
[Rust] Pass the media item fps hint to multimodal processors (#43143)
|
2026-10-08 17:51:06 -07:00 |
|
Sage
|
5a5ea81036
|
[rust-server] warm up each rust listener in-process (#43004)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-08 14:09:46 -07:00 |
|
  
|
943621c336
|
[sgl-router] Render DeepSeek-V4 through sglang-processor (#42665)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-08 20:16:20 +08:00 |
|
 
|
45abea0269
|
[rust-processor] DeepSeek-V4 parity with SGLang, plus a reusable parity harness and skill (#42664)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 18:35:30 +08:00 |
|
Liangsheng Yin
|
5a4d01a3ae
|
[MemCache] Return only the matched length from match_prefix; read KV indices off the node path (#42923)
|
2026-10-08 01:10:14 -07:00 |
|
Rain Jiang
|
c52dcc5a01
|
The sgalng api specs (#41585)
|
2026-10-07 01:55:01 -07:00 |
|
 jain-riaandishandhanani
|
fd62ee84f7
|
feat(grpc): expose follower metadata and node-local KV sources (#39659)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-10-06 16:39:01 -07:00 |
|
 
|
0f57a39152
|
[rust-processor] Gate render, tokenizer and parser behind cargo features (#42663)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 10:58:38 -07:00 |
|
Shangming Cai
|
1291f3175d
|
[rust-processor] Fix chat-template precedence wording in the processor README (#42756)
|
2026-10-06 19:10:26 +08:00 |
|
 
|
cf19ae6d04
|
[rust-processor] Split sglang-processor into tokenizer, render and parser (#42662)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 18:59:02 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
0bdd0cc8dc
|
[Deps] Upgrade the CUDA PyTorch stack to 2.14 (#38641)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-04 00:48:02 -07:00 |
|
    
|
937c0a6cfe
|
Fix unified HiCache physical transfers (#39479)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yonghao Zhuang <yhzhuang@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-04 00:38:56 -07:00 |
|
 
|
4611ea365e
|
[HiCache]: Fix host lock ownership across radix splits (#38480)
Signed-off-by: Lukas Humbel <lhumbel@nvidia.com>
Co-authored-by: Jialin Ouyang <jialino@meta.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-10-04 11:16:04 +08:00 |
|
 
|
2bae12b9b3
|
[HiCache] Fix write-back SWA insert backups tripping the write-through pending-ack assert (#42264)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-03 09:45:56 -07:00 |
|
Liangsheng Yin
|
50be533d09
|
[mem_cache] Rename cache_unfinished_req to checkpoint_req and count cache hits only when a request finishes (#41520)
|
2026-10-01 21:41:45 -07:00 |
|
jain-ria
|
fb92ba1127
|
[Rust] Wire the gRPC server into the frontend lifecycle (#41964)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
|
2026-10-01 10:44:56 -07:00 |
|
jain-ria
|
ebccddce19
|
[Rust] Implement the Rust gRPC adapter for native generation (#41766)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
|
2026-09-30 18:17:42 -07:00 |
|
Sage
|
8e4bcc5ca9
|
[rust-renderer] sglang-processor lib (#41896)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-09-30 15:09:35 -07:00 |
|
jain-ria
|
21ed9fbf44
|
[Rust] Extract shared runtime.v1 protobuf bindings (#41726)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
|
2026-09-30 10:13:08 -07:00 |
|