Commit Graph
11938 Commits
Author SHA1 Message Date
weireweireandweireweire ea48cb04cc Pin scheduler metadata before asynchronous H2D copies (#35944)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-26 22:21:47 -07:00
jacky.cheng f775db03aa [AMD] Fix int32 seqused_k overflow in aiter draft-extend attention (#36541) 2026-08-26 22:06:39 -07:00
weireweireandweireweire 4d5d506486 Publish gated DSV4 DFLASH-family target-prefill read completion (#35947)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-26 21:33:08 -07:00
Jialin Ouyang a2b589fdf8 [Radix Cache] Add test-only TreeCore inspector for shared backend tests (#35791) 2026-08-27 11:17:51 +08:00
a3ae667d67 [Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend (#35634)
Co-authored-by: menyu <menyu@nvidia.com>
Co-authored-by: Jinyan Chen <93358689+liz-badada@users.noreply.github.com>
Co-authored-by: Han Yu <helloyu0903@gmail.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
2026-08-26 19:54:33 -07:00
AMD-yanfeiwang cbfe54fba8 [AMD] Use fast exponentials in C4 and C128 ROCm kernels (#34296) 2026-08-26 19:49:01 -07:00
MickandClaude Opus 5 07570202f0 [VLM] route every multimodal processor through the worker pool's call site (#35342)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 10:27:45 +08:00
Zaili Wang 5adc2880f9 [CPU] Enable ERNIE models on CPU (#35222) 2026-08-27 10:13:10 +08:00
Promisewjx 9d07b9e227 [Performance] Reduce idle DP work in breakable prefill CUDA graphs (#33871) 2026-08-27 10:09:54 +08:00
Bingxu Chen 4f59a8dcfa [AMD][Bugfix] Skip invalid fused MoE reduction for direct top-1 output (#36309) 2026-08-26 18:52:15 -07:00
Haotong Zou b658d64d5b [CPU] Fix rotary_embedding_cpu fake for in-place layouts (#36443) 2026-08-27 09:48:07 +08:00
Haotong Zou 058f99c561 [CPU] Fix truncated KV prefix in intel_amx spec verify (#36430) 2026-08-27 09:42:36 +08:00
Alison Shao 15688fea7d Fix BailingMoeV3 reading enable_dp_lm_head off live topology instead of config (#36584) 2026-08-26 18:41:39 -07:00
Bingxu Chen 862f9ed3d8 [AMD] Fall back to CPU tensor for decode retraction on ROCm (#36343) 2026-08-26 18:32:51 -07:00
20621aa14b [Model] Support Ling-3.0-flash (BailingMoeV3) (#33561)
Signed-off-by: JustinTong <justintong0323@gmail.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 得泽 <zhangkaihong.zkh@antgroup.com>
Co-authored-by: 翎悦 <vito.yy@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: tiwei.btw <tiwei.btw@antgroup.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: 文赋 <zibin.zb@antgroup.com>
Co-authored-by: JustinTong <justintong0323@gmail.com>
2026-08-26 17:27:23 -07:00
paulzhang-tm 8739d56a31 [Spec] Generalize hybrid SWA MTP draft pool routing (#35379) 2026-08-26 17:02:36 -07:00
ec4bdbfa4a [Feature] Beam search support (#31626)
Co-authored-by: cswuyg <cswuyg@gmail.com>
Co-authored-by: cswuyg <496090217@qq.com>
Co-authored-by: Vedant Jhaveri <vedantjh2@gmail.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
2026-08-26 16:56:15 -07:00
Cheng Wan e5a1c5a423 Fix _is_compiling dynamo tracing: import torch instead of sys.modules lookup (#36573) 2026-08-26 16:17:02 -07:00
kuma_Gu2006 7f27bf4708 [Kernel] Declare the PyTorch ABI dependency in sglang-kernel wheels (#36465) 2026-08-26 15:24:26 -07:00
Trevor Morris 1eb629ab4f [NVIDIA] Tune custom all reduce v2 for sm_107 (#36397) 2026-08-26 15:19:31 -07:00
Trevor Morris 3ce243da3f [NVIDIA] Add CUDA 13.4 container for initial Rubin support (#36233) 2026-08-26 15:02:16 -07:00
paulzhang-tm 06694071c6 [Spec] Avoid tensor scalar reads in spec decode allocation (#35377) 2026-08-26 14:51:31 -07:00
Xinyuan Tong a8d716ce8d dsa: widen the fp8 k-cache quant kernel's token_id to int64 (#30859) 2026-08-26 14:22:24 -07:00
Mohammad Miadh AngkadandMohammad Angkad 2935bb8e79 Fix OOB read in mxfp4 MoE weight scales on Hopper (#36456)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-08-26 13:36:49 -07:00
siyu e7e7894016 [Weight Cache] Make daemon socket/ready paths configurable via env (#36299) 2026-08-26 12:38:50 -07:00
weireweireandweireweire 5263568bcb [HiCache] Keep auxiliary load-back out of Full KV pending ownership (#36317)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-27 01:30:38 +08:00
XuFuandMick 924aeee59c [diffusion] feat: support batching for cosmos3 action generation (#36301)
Signed-off-by: FxxxxU <fu18801374388@163.com>
Signed-off-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-26 22:15:03 +08:00
Cheng Wan 413df1f8db config: ServerArgs holds the raw input (#36255) 2026-08-26 05:14:05 -07:00
27c36368b6 fix(moe): guard FP8 delegate activation params (#36275)
Signed-off-by: jikuixie <jikuixie@gmail.com>
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: shyeh25 <206795756+shyeh25@users.noreply.github.com>
2026-08-26 12:12:21 +00:00
Cheng Wan 937af8538b config: the runtime readers take the published bags (#36254) 2026-08-26 05:08:25 -07:00
Cheng Wan 5b7fc61306 config: resolution reads the declarations, not the fields (#36253) 2026-08-26 05:05:28 -07:00
Cheng Wan ae5feb4b9c config: stop handing the record to code that does not read it (#36252) 2026-08-26 05:02:17 -07:00
Cheng Wan d7b144f64e config: publishing is the process entry's job (#36251) 2026-08-26 04:58:41 -07:00
Xiaoyu Zhang 702de26310 [diffusion] make benchmark caches seedable and cover missing native families (#36463) 2026-08-26 19:04:46 +08:00
170da72c13 [diffusion] perf: fuse tanh-GELU into the LongCat-Image DiT FFN up-proj (#36322)
Co-authored-by: 登辉 <yangdenghui.ydh@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-08-26 19:04:06 +08:00
Cheng Wan 8005df61d3 config: spell the parallel config tier at the call site (#36250) 2026-08-26 03:00:28 -07:00
DarkSharpness 689ade69d1 [kernel] Split the custom all-reduce communicator into push/pull planes (#35735) 2026-08-26 17:40:28 +08:00
Aurick QiaoandYuwei An 58ecbba0bd [Feature] Coordinate FullCG prefill across DP-attention ranks (#35640)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
2026-08-26 02:16:02 -07:00
SuperSongandseokwoosong 2511743bd7 [unified-memory] Stop eviction when shared allocation capacity is sufficient (#33091)
Co-authored-by: seokwoosong <seokwoosong@users.noreply.github.com>
2026-08-26 02:06:32 -07:00
Mohammad Miadh AngkadandMohammad Angkad a3c4936438 Sync FlashInfer autotune tactic choice across TP ranks (#35343)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-08-26 16:30:47 +08:00
KnightYao 7ef49e8f7d Rename Spark3 to Spark2.5 (#36416) 2026-08-26 00:04:46 -07:00
3ce4f957eb [diffusion] fix: fix MiniMax-H3 dp_size>1 deadlock and cross-request audio determinism (#36398)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-26 14:54:08 +08:00
Ziang Li 3c9febc68b [Spec][DSA] Add --speculative-dsa-topk-backend (#36313) 2026-08-25 23:35:03 -07:00
weireweireandweireweire db15976fe9 Fix DSV4 DSpark sample-from-anchor initialization (#36419)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-25 23:18:58 -07:00
Tan TrinhandKhoa Pham 04c1036bb3 [Kernel] Skip reserved writes in MLA KV cache (#36003)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
2026-08-25 22:42:23 -07:00
Yihao WangandClaude Opus 5 d7baad0116 [diffusion] Keep the Cosmos3 Super DiT resident on high-memory GPUs (#36375)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-25 21:10:39 -07:00
34de1fb47f fix(test): stabilize nightly precision regression (#34668)
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-08-25 20:04:52 -07:00
ming_wang 2e4773aadd Fix NPUMHATokenToKVPool missing k_data_ptrs/v_data_ptrs (#35820) 2026-08-26 11:01:11 +08:00
Bingxu Chen 5bcc978f2a [AMD][CI] Pass USE_PDL explicitly in the fused MoE gate (#36306) 2026-08-25 19:57:59 -07:00
Xiaoyu Zhang fa3ac61661 [Diffusion] Bound reusable Ulysses A2A staging buffers across shapes (#36327) 2026-08-26 10:57:29 +08:00