  
|
77091cea68
|
[Radix Cache] Sync Rust TreeCore and make it the default (#39627)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
|
2026-09-29 10:18:57 +08:00 |
|
Khoa Pham
|
55cc90b533
|
[CI] Real-model Kimi-Linear PD parity at page, DCP virtual-page, chunk and cached-prefix boundaries (#41378)
|
2026-09-27 20:23:07 -07:00 |
|
Khoa Pham
|
7bdd8fe6ec
|
[CI] Merge the Kimi-Linear PD DCP4 nightly tests and drop exact-token parity (#41321)
|
2026-09-26 09:48:00 -07:00 |
|
 Liangsheng YinandBBuf
|
efd9a40bb8
|
[PD] Share one head-slice helper across mooncake, mori, and nixl (#39660)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-25 16:13:18 -07:00 |
|
Liangsheng Yin
|
516ab77619
|
[Test] Route all sgl-eval benchmarks through run_sgl_eval and deprecate run_eval (#41280)
|
2026-09-25 15:48:38 -07:00 |
|
Liangsheng Yin
|
f88572a57c
|
[Test] Add in-process sgl-eval adapter and move validated GSM8K tests to it (#41216)
|
2026-09-25 13:59:17 -07:00 |
|
 cctryandcctry
|
efff836911
|
[PD] Add decode host receive for custom transfer backends (#40238)
Co-authored-by: cctry <cctry@fb.com>
|
2026-09-23 21:57:33 -07:00 |
|
 inkcherryandDuyi-Wang
|
58f622ebc4
|
Reduce decode bootstrap latency with request-owned speculative KV (#38978)
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-09-23 02:24:53 -07:00 |
|
Liangsheng Yin
|
78980a3b0b
|
[misc] Remove deprecated endpoints, env vars and aliases past two releases (#40795)
|
2026-09-22 18:14:45 -07:00 |
|
Liangsheng Yin
|
d34f7b2326
|
[mem_cache] Clean up SWA/Mamba radix cache leftovers and drop SGLANG_ENABLE_UNIFIED_RADIX_TREE (#40780)
|
2026-09-22 15:40:57 -07:00 |
|
Ma Mingfei
|
046cd6f4ea
|
[XPU][ci]: disable XPU NIXL disaggregation test (#40540)
|
2026-09-22 09:02:22 +08:00 |
|
Cheng Wan
|
506698761d
|
[unified-memory] Hierarchical cache for every unified pool shape (#37507)
|
2026-09-21 16:50:37 -07:00 |
|
Liangsheng Yin
|
76a9065bef
|
[Fix] Raise on undelivered embeddings in send_with_url, fix broken tests (#40502)
|
2026-09-20 17:35:27 -07:00 |
|
Liangsheng Yin
|
f6483e479f
|
[Test] Drop cause-less disabled tests, fix XPU lane, demote quality gates off base-c (#40288)
|
2026-09-20 14:36:02 -07:00 |
|
Khoa Pham
|
b3e4d198af
|
[PD] Bound cached-prefix DCP transfers by pack capacity (#40376)
|
2026-09-21 01:17:15 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
8923f4d779
|
[Test] Fix optimistic prefill disaggregation test after mamba radix cache removal (#40469)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-20 22:39:34 +08:00 |
|
Tri Dao
|
d82d653f96
|
Enable optimistic prefill for Mamba radix-cache models (#40184)
|
2026-09-19 19:28:11 -07:00 |
|
 Zhiqiang Xieandcctry
|
ceb1d2e580
|
[PD] Enable optimistic prefill with buffer-only L3 write-through HiCache (#40043)
Co-authored-by: cctry <csycfl@gmail.com>
|
2026-09-18 16:04:15 -07:00 |
|
Liangsheng Yin
|
87c9f78e99
|
[Fix][PD] Give prefill and decode their own RDMA NICs in disaggregation tests (#39584)
|
2026-09-15 15:07:42 -07:00 |
|
 Shangming CaiandClaude Opus 5
|
47a157f257
|
[CI][Disaggregation] Fix EADDRINUSE flake in test_disaggregation_dwdp_gpt_oss (#39611)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-15 23:05:05 +08:00 |
|
Po-Han Huang (NVIDIA)
|
a2a261963f
|
[CI] Fix SWA decode radix cache NIXL import (#39600)
|
2026-09-15 21:01:05 +08:00 |
|
Liangsheng Yin
|
8565b11003
|
[misc] Trim redundant variants from the 8-gpu-h20 disaggregation test suite (#39544)
|
2026-09-15 01:24:46 -07:00 |
|
Shangming Cai
|
4b186cfea5
|
[CI][PD] Skip the flaky decode HiCache file-backend disaggregation test (#39368)
|
2026-09-15 11:19:03 +08:00 |
|
Cheng Wan
|
2ec4bbcbd4
|
[unified-memory] PD disaggregation for every unified pool shape (#37506)
|
2026-09-13 19:16:43 -07:00 |
|
Cheng Wan
|
db272201a2
|
[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)
|
2026-09-08 16:42:12 -07:00 |
|
 sglang-botandsglang-bot
|
6252993afe
|
chore: update CI test est_time values (#38238)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-09-06 17:49:41 -07:00 |
|
Mick
|
febb360519
|
[VLM] retire aborted disaggregated prefill results (#36988)
|
2026-09-06 10:15:33 +08:00 |
|
 Alex NailsandAlison Shao
|
28262c20df
|
[CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
|
2026-09-02 19:46:08 -07:00 |
|
Liangsheng Yin
|
3a6ed55999
|
[Fix] Shut hicache test servers down gracefully before SIGKILL (#37194)
|
2026-08-30 22:45:40 -07:00 |
|
Shangming Cai
|
c8b56b1f44
|
chore: bump mooncake version to 0.3.13 (#36493)
|
2026-08-26 22:21:15 +08:00 |
|
Ke Bao
|
586211bc46
|
Add PD test for inkling with mxfp8 KV (#35840)
|
2026-08-25 00:12:05 +08:00 |
|
Shangming Cai
|
ac179eec11
|
fix(disagg): PD transfer-failure injection was silently inert (#35890)
|
2026-08-22 11:51:16 +08:00 |
|
 ishandhananiandShangming Cai
|
978244d671
|
[P/D disagg] Decode-side radix cache for SWA hybrid models (unified radix tree) (#27770)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-08-21 09:25:06 +08:00 |
|
 cctryandcctry
|
32d98aad13
|
[HiCache] Allow a retraction host pool smaller than the device pool (#35543)
Co-authored-by: cctry <cctry@fb.com>
|
2026-08-19 22:59:57 -07:00 |
|
Liangsheng Yin
|
ccbe380028
|
[CI] Trim the base-c 4-gpu-h100 stage from 5 shards to 4 (#35407)
|
2026-08-19 00:48:07 -07:00 |
|
 cctryandcctry
|
2e7c85da68
|
[PD] Preserve decode KV across retraction in HiCache (#34801)
Co-authored-by: cctry <cctry@fb.com>
|
2026-08-17 08:49:11 -07:00 |
|
 Khoa PhamandClaude Opus 5
|
f3beb2c529
|
[CI] Disable the prefill CUDA graph on the P worker of test_kimi_linear_pd_dcp4 (#34779)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-13 15:26:21 -07:00 |
|
Shangming Cai
|
0772e79ee7
|
[CI][PD] Pin nccl rendezvous port per side to fix flaky disaggregation tests (#34755)
|
2026-08-14 01:44:20 +08:00 |
|
Liangsheng Yin
|
50cc1aa241
|
[CI] Route mmlu and GB300 MMMU-Pro evals through sgl-eval (#34477)
|
2026-08-12 19:33:21 -07:00 |
|
 Cheng WanandClaude Fable 5
|
ceeaec2078
|
[PD] Support --enable-unified-memory with PD disaggregation (kimi-linear MLA hybrid-Mamba) (#33362)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-10 16:07:58 -07:00 |
|
Liangsheng Yin
|
7c90840bad
|
[CI] Key scheduled CUDA suites by runner_config instead of hand-written jobs (#34186)
|
2026-08-09 16:44:53 -07:00 |
|
 Liangsheng YinandBaizhou Zhang
|
f6a6f5bf1e
|
[CI] Trim redundant nightly test registrations (#34070)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-08-08 01:42:46 -07:00 |
|
Baizhou Zhang
|
eb3cc879e0
|
Install DeepEP from release wheels (#33932)
|
2026-08-07 15:38:44 -07:00 |
|
 YAMYandShangming Cai
|
05c7ebf64c
|
[Disagg][StagingBuffer][2/2] Support radix cache (#30545)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-08-06 23:59:35 +08:00 |
|
Liangsheng Yin
|
c0d5ebd6c4
|
[CI] Move CPU-only unit tests to the CPU suite and trim dead 5090 registrations (#33654)
|
2026-08-05 01:43:29 -07:00 |
|
  
|
5d2dbb35a6
|
[rust-server] PD disaggregation support (#33125)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
|
2026-08-02 18:32:59 -07:00 |
|
Baizhou Zhang
|
fd28242b68
|
[CI] Pin NCCL ports for GB300 PR tests (#33044)
|
2026-07-31 02:28:37 -07:00 |
|
 Khoa PhamandYangmin Li
|
2573190b93
|
feat: support Kimi Linear PD disaggregation with DCP (#32837)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
|
2026-07-31 02:14:09 -07:00 |
|
Xiaojun(Robin) Zhang
|
1af0167493
|
[EPD][VLM] Fix Kimi-VL 2D encoder grids (#32104)
Signed-off-by: Xiaojun Zhang <zhangxiaojunhust@gmail.com>
|
2026-07-29 11:46:17 +08:00 |
|
YAMY
|
91f386a5b2
|
fix(disagg): support pipeline-parallel hybrid-linear transfer (#32270)
|
2026-07-25 13:34:38 -07:00 |
|