 Aurick QiaoandYuwei An
|
26fd7fdaa2
|
[Feature] Support PP in full prefill CUDA graphs (#35451)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-08-27 17:32:00 -07:00 |
|
|
ashwini rathi
|
7cbe564829
|
[Fix][XPU/ROCm/NPU] Defer sgl_kernel.quantization import in expert_pack (#36529)
|
2026-08-27 16:17:24 -07:00 |
|
|
Cheng WanandClaude Opus 5
|
6ff2a20ccf
|
config: the record is not an object that gets passed around (#36622)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 12:57:10 -07:00 |
|
|
Cheng WanandClaude Opus 5
|
fd40a331bf
|
config: a parallel size has one spelling; a patched scope declares its own (#36621)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 12:56:42 -07:00 |
|
|
Cheng WanandClaude Opus 5
|
ca1d7ed8e6
|
config: a parallel leaf with no live counterpart is read bare (#36620)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 12:56:11 -07:00 |
|
|
Cheng WanandClaude Opus 5
|
7c3b5a6732
|
config: every handler declares its cuda-graph decisions (#36725)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 12:55:34 -07:00 |
|
|
Cheng WanandClaude Opus 5
|
bd4bb1781a
|
config: resolution declares, and nothing writes a field (#36618)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 12:53:17 -07:00 |
|
|
Lianmin Zheng
|
a0a2295271
|
Refactor server_args constants and layout (#36676)
|
2026-08-27 12:16:16 -07:00 |
|
|
Mickandjohn.xh
|
20a491d1d3
|
[Fix] Re-encode multimodal embeddings after cache mismatch (#36595)
Co-authored-by: john.xh <dengxuhuijohn@gmail.com>
|
2026-08-27 23:24:30 +08:00 |
|
|
|
97ba99067d
|
Publish per-scheduler load on a dedicated socket for load-aware routers (#34608)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-08-27 19:33:18 +08:00 |
|
|
Lianmin Zheng
|
94183a8d2b
|
Move server args config parser under utils (#36681)
|
2026-08-27 03:34:50 -07:00 |
|
|
Xiaoyu Zhang
|
ad911a5ec0
|
[kernel] Tune LingBot-Video MoE TMA configs for H100 (#36543)
|
2026-08-27 02:47:32 -07:00 |
|
|
Schwinn Saereesitthipitak
|
08315c56df
|
[Fix] Account resident weight memory in KV sizing (#34053)
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
|
2026-08-27 02:43:04 -07:00 |
|
|
Xia Weiwen
|
56fdfc3b26
|
XPU: remove SGLANG_USE_SGL_XPU flag (#34492)
|
2026-08-27 02:38:02 -07:00 |
|
|
Lianmin Zheng
|
3402265989
|
[Core] Refactor server argument choices (#36586)
|
2026-08-27 01:56:03 -07:00 |
|
|
Alison Shao
|
a126a5fa31
|
[CI] Graceful teardown for the radix_cache server fixtures (#36605)
|
2026-08-27 16:36:04 +08:00 |
|
|
MickandClaude Opus 5
|
c2c3320cf0
|
[VLM] feat: size the multimodal preprocessing pool by where preprocessing runs (#35349)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 16:32:58 +08:00 |
|
|
Po-Han Huang (NVIDIA)
|
c608f9bf75
|
[CI] Fix Q8KV8 sparse prefill test fixture (#36639)
|
2026-08-27 01:00:22 -07:00 |
|
|
|
b8a6adadfe
|
[Bug][Spec] fix startup crash and reduce CUDA graph memory usage for speculative adaptive (#35275)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-27 00:46:13 -07:00 |
|
|
jacky.cheng
|
c967cd19b5
|
[AMD] Optimize Qwen3.5 MTP unified attention on gfx950 (#36330)
|
2026-08-27 00:13:49 -07:00 |
|
|
Xun Sun
|
adcf73d7f7
|
[Weight Cache] Enhance test and support EPLB (#36198)
|
2026-08-26 23:11:53 -07:00 |
|
|
|
b294bd4bc7
|
[CPU][CI]: fix a few issues that cause XEON CI failures (#36413)
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
|
2026-08-27 13:59:08 +08:00 |
|
|
weireweireandweireweire
|
4d5d506486
|
Publish gated DSV4 DFLASH-family target-prefill read completion (#35947)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-08-26 21:33:08 -07:00 |
|
|
Alison Shao
|
02dfd37826
|
[CI] Remove GLM-4.1V-9B-Thinking from nightly VLM MMMU eval (#36602)
|
2026-08-26 20:29:38 -07:00 |
|
|
Jialin Ouyang
|
a2b589fdf8
|
[Radix Cache] Add test-only TreeCore inspector for shared backend tests (#35791)
|
2026-08-27 11:17:51 +08:00 |
|
|
|
a3ae667d67
|
[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend (#35634)
Co-authored-by: menyu <menyu@nvidia.com>
Co-authored-by: Jinyan Chen <93358689+liz-badada@users.noreply.github.com>
Co-authored-by: Han Yu <helloyu0903@gmail.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-08-26 19:54:33 -07:00 |
|
|
Michael
|
1c8f2b38cb
|
[AMD][CI] Add DeepSeek-V4-Flash FP8 accuracy coverage on MI30x (#36396)
|
2026-08-26 19:30:07 -07:00 |
|
|
MickandClaude Opus 5
|
07570202f0
|
[VLM] route every multimodal processor through the worker pool's call site (#35342)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-27 10:27:45 +08:00 |
|
|
Promisewjx
|
9d07b9e227
|
[Performance] Reduce idle DP work in breakable prefill CUDA graphs (#33871)
|
2026-08-27 10:09:54 +08:00 |
|
|
Bingxu Chen
|
d2b3e9051d
|
[AMD][CI] Stabilize PyTorch sampling backend test on ROCm (#36307)
|
2026-08-26 18:44:10 -07:00 |
|
|
Alison Shao
|
15688fea7d
|
Fix BailingMoeV3 reading enable_dp_lm_head off live topology instead of config (#36584)
|
2026-08-26 18:41:39 -07:00 |
|
|
ashwini rathi
|
a8b72c4c34
|
[Intel XPU] Fix cross-encoder rerank hang on B580 runners (#36360)
|
2026-08-27 09:33:20 +08:00 |
|
|
|
20621aa14b
|
[Model] Support Ling-3.0-flash (BailingMoeV3) (#33561)
Signed-off-by: JustinTong <justintong0323@gmail.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 得泽 <zhangkaihong.zkh@antgroup.com>
Co-authored-by: 翎悦 <vito.yy@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: tiwei.btw <tiwei.btw@antgroup.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: 文赋 <zibin.zb@antgroup.com>
Co-authored-by: JustinTong <justintong0323@gmail.com>
|
2026-08-26 17:27:23 -07:00 |
|
|
|
ec4bdbfa4a
|
[Feature] Beam search support (#31626)
Co-authored-by: cswuyg <cswuyg@gmail.com>
Co-authored-by: cswuyg <496090217@qq.com>
Co-authored-by: Vedant Jhaveri <vedantjh2@gmail.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
|
2026-08-26 16:56:15 -07:00 |
|
|
Liangsheng Yin
|
45c85c198b
|
[CI] Lower the AWQ Marlin MMLU threshold to 0.80 (#36570)
|
2026-08-26 14:43:20 -07:00 |
|
|
weireweireandweireweire
|
5263568bcb
|
[HiCache] Keep auxiliary load-back out of Full KV pending ownership (#36317)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-08-27 01:30:38 +08:00 |
|
|
Shangming Cai
|
c8b56b1f44
|
chore: bump mooncake version to 0.3.13 (#36493)
|
2026-08-26 22:21:15 +08:00 |
|
|
Cheng Wan
|
413df1f8db
|
config: ServerArgs holds the raw input (#36255)
|
2026-08-26 05:14:05 -07:00 |
|
|
|
27c36368b6
|
fix(moe): guard FP8 delegate activation params (#36275)
Signed-off-by: jikuixie <jikuixie@gmail.com>
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: shyeh25 <206795756+shyeh25@users.noreply.github.com>
|
2026-08-26 12:12:21 +00:00 |
|
|
Cheng Wan
|
937af8538b
|
config: the runtime readers take the published bags (#36254)
|
2026-08-26 05:08:25 -07:00 |
|
|
Cheng Wan
|
5b7fc61306
|
config: resolution reads the declarations, not the fields (#36253)
|
2026-08-26 05:05:28 -07:00 |
|
|
Cheng Wan
|
ae5feb4b9c
|
config: stop handing the record to code that does not read it (#36252)
|
2026-08-26 05:02:17 -07:00 |
|
|
Cheng Wan
|
d7b144f64e
|
config: publishing is the process entry's job (#36251)
|
2026-08-26 04:58:41 -07:00 |
|
|
Cheng Wan
|
8005df61d3
|
config: spell the parallel config tier at the call site (#36250)
|
2026-08-26 03:00:28 -07:00 |
|
|
DarkSharpness
|
689ade69d1
|
[kernel] Split the custom all-reduce communicator into push/pull planes (#35735)
|
2026-08-26 17:40:28 +08:00 |
|
|
Aurick QiaoandYuwei An
|
58ecbba0bd
|
[Feature] Coordinate FullCG prefill across DP-attention ranks (#35640)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-08-26 02:16:02 -07:00 |
|
|
SuperSongandseokwoosong
|
2511743bd7
|
[unified-memory] Stop eviction when shared allocation capacity is sufficient (#33091)
Co-authored-by: seokwoosong <seokwoosong@users.noreply.github.com>
|
2026-08-26 02:06:32 -07:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
ffc431cd4c
|
[CI] Fix stale tool_call_parser key in Spark2.5 detector test (#36464)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-08-26 01:34:39 -07:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
a3c4936438
|
Sync FlashInfer autotune tactic choice across TP ranks (#35343)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-08-26 16:30:47 +08:00 |
|
|
Jialin Ouyang
|
bede6bc37c
|
Fix unified HiCache PP test import (#36454)
|
2026-08-26 15:35:18 +08:00 |
|