Sage
|
611a703061
|
[Chore] api: add fields to generate request (#45164)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-23 17:10:23 +08:00 |
|
 
|
aae2145eb2
|
[Feat] radix-tree: Report the last visited node and a shorter FULL device match in match results (#45703)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-22 13:11:33 -07:00 |
|
 ApeiriaandRain Jiang
|
8d7df07a56
|
[Feat] rust-server: Add HiCache storage management endpoints (#44726)
Signed-off-by: 0130w <1157374677@qq.com>
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
|
2026-10-22 04:01:35 +00:00 |
|
 
|
42db2db4a8
|
[Fix] rust-server: Check only a client-sent max_new_tokens against the context window (#45460)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 15:50:13 -07:00 |
|
 
|
5e79333c95
|
[Refactor] radix-tree: Reuse the insert walk, component hooks and bindings for custom tree cores (#45439)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-21 10:53:26 -07:00 |
|
Shawn Yang
|
dd9ea06c00
|
[Fix] rust: Format health probe handle setup (#45606)
|
2026-10-21 21:40:08 +08:00 |
|
 
|
ca72dad953
|
[Fix] rust-server: Answer health probes a busy scheduler skipped on the response ring (#45475)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 03:41:36 -07:00 |
|
 
|
21f775cd97
|
[Feat] rust-server: Let the launcher set the default max_new_tokens for /generate (#45431)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 01:58:34 -07:00 |
|
 metamergebotandshodoco
|
6bd1c76735
|
[Fix] rust-server: Drop the fixed 64-item multimodal cap in favor of --limit-mm-data-per-request (#45432)
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-20 20:25:22 -07:00 |
|
 
|
cc7ae372ac
|
[Refactor] radix-cache: Route pending-backup split bookkeeping through one component action (#45242)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-20 13:24:49 -07:00 |
|
 
|
0b536ca112
|
[Fix] radix-cache: Separate logical and reclaimable value lengths in tree components (#45238)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-20 13:24:20 -07:00 |
|
 
|
dc62c3effd
|
[Feat] radix-tree: Report each path node's child count in collect_path_info (#45241)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-20 13:23:59 -07:00 |
|
Liangsheng Yin
|
82c9a8b037
|
[Perf] deepseek-v4.1: Default PD to MegaAttention, with the KV layout in the PD handshake (#45075)
|
2026-10-18 21:16:45 -07:00 |
|
  
|
fea48754de
|
[Feat] rust/grpc: Add ListModels, Detokenize, and Abort to api.v1 (#42118)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-10-19 09:53:56 +08:00 |
|
   
|
3b932cde26
|
[Fix] VLM: harden Kimi image cache identity across preprocessing and radix hashing (#43043)
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-18 17:39:37 +08:00 |
|
Kaushik Chatterjee
|
3acfa2efcc
|
[Feat] runtime: Support tokenized multimodal generation (#42833)
|
2026-10-18 12:35:51 +09:00 |
|
 
|
05c1539098
|
[Feat] unified_cache: Support hybrid SWA + Mamba models in the Mooncake direct linker (#41343)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2026-10-17 13:24:08 -07:00 |
|
 
|
f75232cb42
|
[Fix] hicache: Order write-back host copies after the forward that produced the KV (#44800)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-17 01:31:40 -07:00 |
|
 
|
0d13efb2b8
|
[Feat] rust-server: Serve /v1/tokenize and /v1/detokenize from the Rust frontend (#44767)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-17 01:30:50 -07:00 |
|
 
|
5cbe2371a5
|
[Feat] rust-server: Report Python's launch-time /server_info fields from the Rust frontend (#44764)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-16 18:14:50 -07:00 |
|
 
|
b62a48ee15
|
[Feat] sglang-server: Serve /flush_cache from the Rust frontend (#44766)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-16 17:24:01 -07:00 |
|
 metamergebotandmetamergebot
|
f39c2693aa
|
[CI] rust-server: Raise the ChunkEvent frame-size cap to 152 bytes (#44773)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-16 13:47:52 -07:00 |
|
 
|
553068af25
|
[Fix] rust-server: Honour cache_salt and require_reasoning on /generate (#44533)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-16 10:38:09 -07:00 |
|
 
|
26a2f18c02
|
[Feat] sglang-server: serve /v1/loads from the Rust frontend (#44532)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-16 10:35:37 -07:00 |
|
 shodocoandmetamergebot
|
2957ff3165
|
[Fix] sglang-server: Keep the matched stop token in output_ids (#42637)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-15 18:51:47 -07:00 |
|
 
|
f110b2f801
|
[Feat] rust-server: Report cached_tokens and reasoning_tokens in meta_info (#44531)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 17:50:27 -07:00 |
|
 
|
0b1a73599a
|
[Feat] rust-server: Apply the x-override-* request headers (#44312)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 15:50:04 -07:00 |
|
 
|
02a43eeef6
|
[Feat] rust-server: Attach configured metadata headers to a healthy /health_generate (#44315)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 12:04:23 -07:00 |
|
 
|
209f8220d6
|
[Fix] sglang-server: Honour extra_key on the Rust frontend's /generate (#44207)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:44:31 -07:00 |
|
  
|
e7d6a88bfc
|
[HiCache] Buffer-only L3 for an auxiliary SWA window; load back only missing window rows (#43932)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: houseroad <houseroad@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-14 16:43:24 -07:00 |
|
 
|
aa8793f33b
|
[Rust] Serve scheduler metrics on the Rust frontend's /metrics (#43942)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:43:06 -07:00 |
|
 
|
9732188a58
|
[Rust] Serve /weights_checker from the Rust frontend (#43926)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:41:10 -07:00 |
|
Rain Jiang
|
12dc623102
|
[Chore] rust: Remove the sglang-renderer crate (#43451)
|
2026-10-14 11:43:37 -07:00 |
|
  
|
010776e94f
|
[KV events] Publish opaque LoRA block IDs and adapter names (#42817)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 22:56:28 +08:00 |
|
 
|
204644c2dc
|
[Fix] sglang-processor: Follow Python's OpenAI layer through #43027, #37577, #43006, #43026, #43005 (#44243)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 21:06:13 +08:00 |
|
 
|
817781b828
|
[Feat] sgl-router: Render Qwen3.8 (Max, 27B, Flash-Next) through sglang-processor (#43689)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 17:09:35 +08:00 |
|
 Kan WuandClaude Opus 5.5
|
53a24c448e
|
[Feat] sgl-router: Render Kimi-K3 through sglang-processor (#43608)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 23:40:18 -07:00 |
|
 Kan WuandClaude Opus 5.5
|
4560da58ee
|
[sgl-router] Render GLM-5.3 and GLM-5.3-Flash through sglang-processor (#43625)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:19:44 +08:00 |
|
 HEJIAN SANGandClaude Opus 5.5
|
a832609b92
|
[Feature] Return output top logprobs as flat base64 arrays on request (#42890)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 15:58:31 -07:00 |
|
 
|
79af3df346
|
[gRPC] Move runtime.v1 bindings to tonic 0.14, report OpenAI status codes, return text on request (#42673)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 13:46:15 -07:00 |
|
 Xinyuan TongandNihar Patel
|
7dc2930585
|
[Feature] Add Aaronson-Gumbel text watermarking (#37577)
Co-authored-by: Nihar Patel <nihpat95@gmail.com>
|
2026-10-13 12:47:50 -07:00 |
|
 
|
ce5352a814
|
[Rust] Serve any model name on the OpenAI chat and completions routes (#43923)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-13 11:58:57 -07:00 |
|
 
|
149ef7d1b7
|
[Rust] Let an embedding package wrap the frontend HTTP app (#43924)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-13 11:44:43 -07:00 |
|
Rain Jiang
|
e98c6d7b25
|
Rainj me/rust bench (#43950)
|
2026-10-13 11:07:42 -07:00 |
|
 
|
e775fa7253
|
[Build][CI] Drop Python 3.10: require Python 3.11+ and run CUDA CI on Python 3.12 (#43021)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-10-12 18:40:16 -07:00 |
|
Артем Савкин
|
d1357bf87b
|
[NPU] Diffusion CI fixes (#43210)
|
2026-10-12 14:53:51 +03:00 |
|
 
|
77a15cf4e2
|
[MemCache] Add shared component size and path APIs to the tree core interface (#43722)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-11 20:14:07 -07:00 |
|
 
|
95ce9caaf2
|
[Rust] Lock hyper 1.12.0 and want 0.3.2 in the rust workspace (#43724)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-11 20:12:55 -07:00 |
|
 Banruo LiuandShangming Cai
|
d62b9c2480
|
[KV Events] Publish LoRA adapter names and namespaced block hashes (#42455)
Signed-off-by: Banruo Liu <lichangxinlivingshade@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-11 23:23:30 +08:00 |
|
Shuwen Wang
|
99d6f4e158
|
[MemCache] refactor: require an anchored lock receipt for non-root releases (#41452)
|
2026-10-10 22:43:49 +08:00 |
|