AMD-yanfeiwang
|
a3abea3560
|
[Fix] sgl-router: Resend on a closed pooled connection; add --disable-circuit-breaker (#44075)
|
2026-10-18 18:23:18 +08:00 |
|
  
|
3d61bdd2c9
|
[Feat] sgl-router: Serve the remaining native gRPC inference RPCs (#42681)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-16 16:23:17 +08:00 |
|
 
|
a2981ab8ea
|
[Feat] sgl-router: Serve native gRPC ChatComplete (#42674)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 13:11:36 +08:00 |
|
 
|
a57707377f
|
[Fix] sgl-router: Send disagg_prefill_dp_rank to decode under --dp-aware (#44072)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-15 22:42:33 +08:00 |
|
AMD-yanfeiwang
|
08f15e76bb
|
[Feat] sgl-router: Add --dp-rank-policy round_robin for --dp-aware (#43511)
|
2026-10-15 12:03:01 +08:00 |
|
  
|
c964d9ba20
|
[Feat] sgl-router: Separate LoRA block IDs from prompt lookup keys (#42818)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-15 00:50:19 +08:00 |
|
 
|
204644c2dc
|
[Fix] sglang-processor: Follow Python's OpenAI layer through #43027, #37577, #43006, #43026, #43005 (#44243)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 21:06:13 +08:00 |
|
 
|
817781b828
|
[Feat] sgl-router: Render Qwen3.8 (Max, 27B, Flash-Next) through sglang-processor (#43689)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 17:09:35 +08:00 |
|
 
|
58f2c923ed
|
[Feat] sgl-router: skip engines at an admission cap in power-of-two; forward x-sglext headers (#44218)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-10-14 14:59:06 +08:00 |
|
 Kan WuandClaude Opus 5.5
|
53a24c448e
|
[Feat] sgl-router: Render Kimi-K3 through sglang-processor (#43608)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 23:40:18 -07:00 |
|
 
|
180933518e
|
[sgl-router] Serve the Anthropic Messages API on /v1/messages (#42316)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-10-12 17:56:08 +08:00 |
|
 
|
506f140166
|
[sgl-router] Read finished /generate streams to the end; expose reorg admission caps as flags (#43233)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 10:59:09 +08:00 |
|
  
|
3805d78796
|
[sgl-router] Serve /v1/chat/completions through /generate, with reasoning parsing (#42998)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-09 19:17:52 +08:00 |
|
 
|
b130f8af02
|
[sgl-router] Serve /v1/completions through /generate, with the shared OpenAI layer (#42997)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 16:04:04 +08:00 |
|
 
|
3ba90f1b52
|
[rust] Update Dynamo frontend crates to latest compatible releases (#42666)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 11:46:01 +08:00 |
|
 
|
9172a73725
|
[sgl-router] Keep charset=utf-8 on streamed responses (#43232)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 11:44:52 +08:00 |
|
  
|
943621c336
|
[sgl-router] Render DeepSeek-V4 through sglang-processor (#42665)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-08 20:16:20 +08:00 |
|
 
|
2167cf90c3
|
[sgl-router] Bound streaming time-to-headers by --request-timeout-secs (retry 5/5) (#42632)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 18:35:11 +08:00 |
|
  
|
662879e495
|
[sgl-router] Back off between retry attempts (retry 4/5) (#42631)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-06 17:06:45 +08:00 |
|
  
|
bb4d0a13c1
|
[sgl-router] Retry failed dispatches on another worker (retry 3/5) (#42630)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-06 16:28:52 +08:00 |
|
 
|
8c273d6813
|
[sgl-router] Let selection skip workers a request already failed on (retry 1/5) (#42628)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 15:10:51 +08:00 |
|
  
|
70f0b7351e
|
[sgl-router] Improved policy balanced mode (#42545)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-05 09:48:37 -07:00 |
|
  
|
08fa37e48d
|
[sgl-router] Add reorg bucket config with per-group admission (#42429)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
|
2026-10-05 18:17:32 +08:00 |
|
 
|
a96b146491
|
[sgl-router] Move pressure and prefix signals out of legacy policies (#42428)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 18:10:29 +08:00 |
|
  
|
07064fd4a4
|
[sgl-router] Credit routed prompts before their KV events arrive (#42276)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
|
2026-10-03 14:57:49 -07:00 |
|
  
|
fd5e68f99e
|
[sgl-router] Repair KV-event sequence gaps from the engine's replay socket (#42275)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
|
2026-10-04 04:43:17 +08:00 |
|
 
|
19794f5743
|
[sgl-router] Add SGLang's /v1/classify (#42258)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-03 05:56:16 +08:00 |
|
 
|
ebf161cea4
|
[sgl-router] Add SGLang's /v1/rerank (#42205)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-03 05:33:40 +08:00 |
|
 Kan WuandKan Wu
|
8c9030ce3f
|
[sgl-router] Unify reorg session and cache affinity modes (#41990)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-03 05:21:22 +08:00 |
|
 
|
edee4308bc
|
[sgl-router] Add OpenAI /v1/embeddings (#42191)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 20:18:24 +08:00 |
|
 
|
1330e437e1
|
[sgl-router] Add native /generate endpoint (#42147)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 20:09:04 +08:00 |
|
 Kan WuandKan Wu
|
d7565215ec
|
[sgl-router] Route to a specific DP rank inside multi-rank workers (--dp-aware) (#41974)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-01 14:50:59 -07:00 |
|
   
|
41cbe65de0
|
[sgl-router] Enforce compatible PD version groups (#41613)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 20:24:20 +08:00 |
|
  
|
3b2ad1c6ae
|
[sgl-router] Fail fast and cancel decode when prefill fails (#41612)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 19:35:56 +08:00 |
|
  
|
46637965ab
|
[sgl-router] Allow load-only routing without a tokenizer (#41611)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 18:30:35 +08:00 |
|
   
|
315080a0de
|
[sgl-router] Exclude portless prefills and retry bootstrap discovery (#41610)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 14:32:14 +08:00 |
|
  
|
36330b8c08
|
[Router] k8s e2e for cache-aware peer bootstrap (12/13) (#40698)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 09:42:59 +08:00 |
|
 
|
4b3f63ec70
|
[Router] Prove a bootstrapped replica answers like the one it copied (11/13) (#40697)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-30 19:19:26 +08:00 |
|
 
|
c5a38d3998
|
[sgl-router] Add --tokenizer-backend fast and --tokenizer-l1-cache-mb (#41268)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 18:55:58 +08:00 |
|
 
|
6aacca2d91
|
[Router] Name a replica's siblings with --kv-peer-selector (3/13) (#40689)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-28 18:49:09 +08:00 |
|
  
|
47ad1928a2
|
[sgl-router] Scope input_ids forwarding by renderer: all text chats for DeepSeek-V4 (#41226)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-28 18:37:40 +08:00 |
|
 
|
b4584ab838
|
[sgl-router] Take SGLang's render defaults: --default-chat-template-kwargs and thinking/effort envs (#41221)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-27 11:01:17 +08:00 |
|
 
|
7152aabdcb
|
[sgl-router] Track input_ids forwarding outcomes per chat request (#41185)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-26 13:09:46 +08:00 |
|
 Kan WuandClaude Fable 5.1
|
2e3568567b
|
[sgl-router] Launch reorg routing with existing policy options (#40766)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-23 10:18:11 +08:00 |
|
 
|
5c18780c31
|
[Router] Keep e2e workers inside the job's CUDA_VISIBLE_DEVICES allotment (#40686)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-22 11:32:12 -07:00 |
|
   
|
2032f3a071
|
[Router] Abort the engine when a client disconnects mid-request (#39461)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
|
2026-09-22 12:35:56 +08:00 |
|
Kan Wu
|
59a723ef1e
|
[sgl-router] refactor - SLO ordering for bucket selection (#40292)
|
2026-09-22 11:16:10 +08:00 |
|
Kan Wu
|
27f796ca6c
|
[sgl-router] Fix readiness, IPv6 discovery, logging, and model validation (#40604)
|
2026-09-22 11:13:06 +08:00 |
|
 Kan WuandShangming Cai
|
008470abd8
|
[sgl-router] Bound streaming lifetimes and release guards on idle disconnect (#40391)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-21 10:07:07 -07:00 |
|
Kan Wu
|
0f6761b54f
|
[sgl-router] Add SGLang-compatible DeepSeek V4.1 Flash rendering (#40532)
|
2026-09-21 18:35:09 +08:00 |
|