AMD-yanfeiwang
|
a3abea3560
|
[Fix] sgl-router: Resend on a closed pooled connection; add --disable-circuit-breaker (#44075)
|
2026-10-18 18:23:18 +08:00 |
|
AMD-yanfeiwang
|
08f15e76bb
|
[Feat] sgl-router: Add --dp-rank-policy round_robin for --dp-aware (#43511)
|
2026-10-15 12:03:01 +08:00 |
|
  
|
c964d9ba20
|
[Feat] sgl-router: Separate LoRA block IDs from prompt lookup keys (#42818)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-15 00:50:19 +08:00 |
|
 
|
58f2c923ed
|
[Feat] sgl-router: skip engines at an admission cap in power-of-two; forward x-sglext headers (#44218)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-10-14 14:59:06 +08:00 |
|
 Kan WuandClaude Opus 5.5
|
53a24c448e
|
[Feat] sgl-router: Render Kimi-K3 through sglang-processor (#43608)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 23:40:18 -07:00 |
|
 
|
3ba90f1b52
|
[rust] Update Dynamo frontend crates to latest compatible releases (#42666)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 11:46:01 +08:00 |
|
 
|
8c273d6813
|
[sgl-router] Let selection skip workers a request already failed on (retry 1/5) (#42628)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 15:10:51 +08:00 |
|
  
|
70f0b7351e
|
[sgl-router] Improved policy balanced mode (#42545)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-05 09:48:37 -07:00 |
|
  
|
08fa37e48d
|
[sgl-router] Add reorg bucket config with per-group admission (#42429)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
|
2026-10-05 18:17:32 +08:00 |
|
 
|
a96b146491
|
[sgl-router] Move pressure and prefix signals out of legacy policies (#42428)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 18:10:29 +08:00 |
|
  
|
fd5e68f99e
|
[sgl-router] Repair KV-event sequence gaps from the engine's replay socket (#42275)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
|
2026-10-04 04:43:17 +08:00 |
|
 Kan WuandKan Wu
|
8c9030ce3f
|
[sgl-router] Unify reorg session and cache affinity modes (#41990)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-03 05:21:22 +08:00 |
|
 Kan WuandKan Wu
|
d7565215ec
|
[sgl-router] Route to a specific DP rank inside multi-rank workers (--dp-aware) (#41974)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-01 14:50:59 -07:00 |
|
   
|
41cbe65de0
|
[sgl-router] Enforce compatible PD version groups (#41613)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 20:24:20 +08:00 |
|
  
|
46637965ab
|
[sgl-router] Allow load-only routing without a tokenizer (#41611)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 18:30:35 +08:00 |
|
   
|
315080a0de
|
[sgl-router] Exclude portless prefills and retry bootstrap discovery (#41610)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 14:32:14 +08:00 |
|
 
|
4b3f63ec70
|
[Router] Prove a bootstrapped replica answers like the one it copied (11/13) (#40697)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-30 19:19:26 +08:00 |
|
 
|
c5a38d3998
|
[sgl-router] Add --tokenizer-backend fast and --tokenizer-l1-cache-mb (#41268)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 18:55:58 +08:00 |
|
 
|
b4584ab838
|
[sgl-router] Take SGLang's render defaults: --default-chat-template-kwargs and thinking/effort envs (#41221)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-27 11:01:17 +08:00 |
|
Kan Wu
|
59a723ef1e
|
[sgl-router] refactor - SLO ordering for bucket selection (#40292)
|
2026-09-22 11:16:10 +08:00 |
|
Kan Wu
|
0f6761b54f
|
[sgl-router] Add SGLang-compatible DeepSeek V4.1 Flash rendering (#40532)
|
2026-09-21 18:35:09 +08:00 |
|
 
|
0abb251a20
|
[sgl-router] Match DeepSeek V4 rendering to SGLang (#40530)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-21 17:56:41 +08:00 |
|
 Kan WuandClaude Fable 5.1
|
2016f5e7a1
|
[sgl-router] Add Kimi-K3 rendering with SGLang parity (#40390)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 17:38:49 +08:00 |
|
 Kan WuandClaude Fable 5.1
|
a9871012ac
|
[sgl-router] refactor - generalized admission policy definitions (#40271)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 16:26:30 +08:00 |
|
 Kan WuandClaude Fable 5.1
|
fcb080bd40
|
[sgl-router] refactor - cache-aware policy (#40366)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 13:53:57 +08:00 |
|
 Kan WuandClaude Fable 5.1
|
4027740569
|
[sgl-router] refactor - session-aware policy (#40379)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-20 17:22:36 -07:00 |
|
 Kan WuandClaude Fable 5.1
|
aedda8377e
|
[sgl-router] refactor - layout BucketResolver, Bucket, EngineGroup and implement PowerOfTwo (#40241)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-20 16:57:07 -07:00 |
|
 Kan WuandClaude Fable 5.1
|
4a9dc5c4af
|
[sgl-router] refactor - move policy-required states under src/state (#40272)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-20 16:49:23 -07:00 |
|
  
|
3bf243d6a9
|
[Router] Shard the cache-aware KV tree by chain root (#39167)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-18 15:00:17 +08:00 |
|
 
|
e4cbb28ea1
|
[router] Improve SGLang chat render parity (#39133)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-17 23:53:40 +08:00 |
|
 Kan WuandClaude Fable 5.1
|
3ce7e2a29f
|
[sgl-router] Render chat prompts with dynamo-render (#38983)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-17 15:57:20 +08:00 |
|
 
|
7835f1de9a
|
[Router] Add the shutdown-drain configuration surface (#39015)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 00:26:50 -07:00 |
|
 
|
c1f5b4736a
|
[Router] Add --worker-queue-limit: stop sending cache-affinity traffic to a queueing worker (#39168)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 13:24:48 +08:00 |
|
 
|
5f17e3a75f
|
[Router] Fleet-wide sampling contract 1/3: the config surface (#39000)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-15 21:39:06 -07:00 |
|
 
|
63845a1bb2
|
[router] Resolve a wire protocol per worker at registration (#39004)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-15 16:54:37 -07:00 |
|
ishandhanani
|
3f871a246c
|
feat(agent sessions): attribute stored KV cache blocks to sessions (#37482)
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-09-14 21:34:49 -07:00 |
|
 
|
45b511b2ef
|
[Router] Honor KV-event storage tiers in the cache-aware tree (1/4) (#39108)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-14 21:18:15 -07:00 |
|
Vincent Gao
|
8e7deb329e
|
[Router] Preserve global cache affinity with bucket routing (#38814)
Signed-off-by: Vincent Gao <vincentbo@linux.alibaba.com>
|
2026-09-11 17:41:27 +08:00 |
|
 
|
5bebe7a033
|
[Router] Add bucket-aware policy domains and native cache indexing (#38108)
Signed-off-by: Vincent Gao <vincentbo@linux.alibaba.com>
Co-authored-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: yangbodong22011 <13137470+yangbodong22011@users.noreply.github.com>
|
2026-09-06 19:47:51 +08:00 |
|
  
|
ecd97de1fc
|
[Router] Add load-aware prefill admission and bounded policy proposals (#37843)
Signed-off-by: Vincent Gao <vincentbo@linux.alibaba.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-05 11:53:26 +08:00 |
|
 Vincent Gaoandinkcherry
|
54cadad151
|
[Router] Add composable scoring and eligibility policies (#37731)
Co-authored-by: inkcherry <mingzhi.liu@amd.com>
|
2026-09-04 00:01:41 +08:00 |
|
  
|
360d10d6bc
|
[Feature] Add process-local in-memory KV indexer and Router integration (#33370)
Co-authored-by: Wu, Yutong <yutong.wu@amd.com>
Co-authored-by: TianDi101 <ditian12@amd.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-08-20 10:45:35 +08:00 |
|
Jia-Wei Jiang
|
a88ba6cc0b
|
[Fix] Reduce power of two to constant time (#28228)
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
|
2026-06-14 23:25:22 -07:00 |
|
 Kangyan-ZhouandClaude Opus 4.8
|
c0dfe4c8ec
|
[router] Reconcile workers that registered without resolving model_ids (#27980)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-14 18:47:50 -07:00 |
|
 Kangyan-ZhouandClaude Opus 4.8
|
6bc3953b48
|
feat(agentic router): add sticky-session routing policy (#27394)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-07 20:05:27 -07:00 |
|
 Kangyan-ZhouandClaude Opus 4.8
|
bcf89928b4
|
[router] Configure experimental sgl-router via CLI flags instead of a config file (#27073)
Signed-off-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-05 10:02:10 +08:00 |
|
 Kangyan-ZhouandClaude Opus 4.7
|
6e8fe176be
|
sgl-router: experimental Rust HTTP router for SGLang worker pools (#25851)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-25 15:34:05 +08:00 |
|