Commit Graph
8817 Commits
Author SHA1 Message Date
gjsheu d9d719b270 [npu] [bugfix] Add contiguous operation during quantized weight loading. (#26309) 2026-05-27 19:55:58 +08:00
zhaozx-cn 83d5f4604c [NPU]add decord2 for npu (#26308)
Signed-off-by: zhaozx-cn <zhaozx2116@163.com>
2026-05-27 19:48:16 +08:00
Makcum888eandronnie_zheng 3afc80d781 [diffusion] Fix multi image input for GLM-Image (#26311)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-27 12:33:20 +03:00
Jialin Ouyang 98bc6f3c22 API Perf: Replace pydantic per-element validation with C loop validation (#26355) 2026-05-27 02:04:07 -07:00
Liangsheng Yin 216ed270e5 refresh resolve_seq_lens_cpu comments (#26463) 2026-05-27 00:51:43 -07:00
Mick f70e604101 [diffusion] fix: fix diffusion serve warmup defaults (#26247) 2026-05-27 15:43:47 +08:00
Liangsheng Yin 163b970127 [core] WAR barrier for overlap schedule buffer writes, without fwd occupancy cost (#26380) 2026-05-26 23:58:32 -07:00
ant-yyand得泽 dea85c30f4 Add Ling_2_6 (#23837)
Signed-off-by: vito.yy <vito.yy@antgroup.com>
Co-authored-by: 得泽 <zhangkaihong.zkh@antgroup.com>
2026-05-27 14:57:23 +08:00
Makcum888e 9060509214 [NPU] fix CI (#26390) 2026-05-27 09:45:42 +03:00
xdtbynd 21d0e74aff Disable torch.compile for NPU in speculative overlap utils (#26403) 2026-05-27 12:30:53 +08:00
d45ee3f6c5 [HiCache] fix: Mooncake Dummy Client mode for hybrid Mamba models (#25278)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Teng Ma <stmatengss@users.noreply.github.com>
2026-05-27 10:29:52 +08:00
Liangsheng Yin 1051a8456f [core] Maintain req_pool_indices_cpu host mirror (like seq_lens_cpu) (#26425) 2026-05-26 18:59:54 -07:00
Liangsheng Yin 6076066e38 Add mooncake_tcp transfer backend (mooncake over TCP) (#26346) 2026-05-26 18:15:55 -07:00
vikram singh shekhawatandMa Mingfei 737c6cd6d1 [XPU] Add registry mechanism for XPU CI tests (#25405)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-27 08:56:59 +08:00
87c3171aaa [CPU] Add support for Qwen3-vl and Qwen3-omni (#12662)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-05-27 08:56:09 +08:00
Dawid Majchrowski c317beda99 [diffusion] model: support a new model (#24994) 2026-05-27 08:51:03 +08:00
Piotr Mazurek 468c565168 Wire YARN rope_parameters through LFM2 and LFM2-MoE attention (#26187) 2026-05-26 23:00:22 +00:00
Joel Schlosser 6989fede3c Purge usage of pytorch named tensors (#25911) 2026-05-26 14:58:57 -07:00
Yilong Zhaoandhappierpig 1a05b511e4 dp: refactor idle batch logic (#25025)
Co-authored-by: happierpig <zhaoyilong217@sjtu.edn.cn>
2026-05-26 14:22:25 -07:00
Qiaolin Yu dd6f073377 Reland "[perf][spec decoding] Skip full-vocab softmax in EAGLE draft when topk == 1 (#26235)" (#26397) 2026-05-26 14:14:48 -07:00
Serge PanevandYihao Wang 499eecce22 [NemotronH] V3 Omni wrapper: WeightsMapper + config round-trip (#25023)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
2026-05-26 20:34:05 +00:00
Ziang Li 2b1e53c98d [RL] Fix FP8 skip matching for trailing-dot prefixes (#26287) 2026-05-26 20:30:08 +00:00
Liangsheng Yin ec6f8d61f7 [Spec] Async-assert probes across EAGLE/MTP; zero tgt_cache_loc (#26335) 2026-05-26 11:34:03 -07:00
Venkatesh GuduruandvguduruTT 6c8128650e [Bugfix] Fix flashinfer_cutlass MoE crash when intermediate_size_per_partition is not 16-aligned (#22627)
Co-authored-by: vguduruTT <venkatesh.guduru@mulitcorewareinc.com>
2026-05-26 16:58:33 +00:00
Zhangheng 38f32c38ab [UnifiedRadixTree]: Support L3 HiStorage framework (#26062) 2026-05-26 22:38:00 +08:00
Jun Liu c47f0e7cdd [PD] Fix top logprobs crash in prefill path (#26299) 2026-05-26 22:01:10 +08:00
Shangming Cai c8c1aed5e9 [PD] Fix cross-rank queue divergence by gating metadata readiness before all-reduce (#26394)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-05-26 21:59:42 +08:00
Yongfei Xu 98eb84497d [PP] Skip PP output communication for pure chunked prefill batches (#26148) 2026-05-26 21:59:18 +08:00
Michael 9409969fd5 Revert "[perf][spec decoding] Skip full-vocab softmax in EAGLE draft when topk == 1 (#26235)" (#26358) 2026-05-26 02:47:52 -07:00
fzyzcjy d9c82934c8 Extract Scheduler init methods and add skills to enforce the splitting requirements (#26271) 2026-05-26 17:45:09 +08:00
Chao Shi 48f3264807 [HiCache]: Check return code of cudaHostRegister (#26301) 2026-05-26 17:44:15 +08:00
roikoren755 e958f4561f [feat] Support extra_buffer in Mamba2-based models (#15829)
Signed-off-by: Roi Koren <roik@nvidia.com>
2026-05-26 16:03:29 +08:00
Liangsheng Yin 7e6e5efe51 Revert "fix(tool_call): normalize non-standard JSON Schema types in tool params" (#26379) 2026-05-26 00:49:41 -07:00
Zhonghua Deng dabdd91ef3 [EPD] Cross-request batching for image/audio encoder (#25964) 2026-05-26 15:38:59 +08:00
Yuan Luoandluoyuan.luo d34d4d9f5f [GDN] Support SM100 CuTeDSL GDN Prefill Kernel (#26200)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-05-26 15:38:29 +08:00
Xinyuan Tong 64c7c6851b fix(tool_call): normalize non-standard JSON Schema types in tool params (#23476) 2026-05-26 15:23:59 +08:00
chengchao23 137168539a [Perf][Moe]improve cutlass_moe_fp4 performance by using apply_router_weight_on_i… (#19493) 2026-05-26 00:07:49 -07:00
+2 3f5e2c7688 [AMD] Dsv4/pr2 compressor opt (#26208)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: amd-danli103 <danli103@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
Co-authored-by: yichiche@amd.com <jacky.cheng>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-05-25 23:54:40 -07:00
Shaojun Zhou 7c0fbc8c2e fix: fix fa3 cross-attention batched-decode for per-request varlen encoder (#25045) 2026-05-26 14:26:15 +08:00
Mick 63a89bf1a9 [kernel] reuse wna16 marlin moe workspace (#26112) 2026-05-26 13:19:13 +08:00
Yuxuan Zhang 7ef06bfc06 GLM-4.7-Flash: standalone MLA impl and MLA NextN/MTP (#26088) 2026-05-26 13:17:39 +08:00
xutizhou 59cad671e2 Support DeepSeek V4 DeepEP Waterfill (#25391) 2026-05-25 21:04:26 -07:00
mispa-msandMick 3142278c5f [diffusion] feat: layerwise NVTX markers for Nsight Systems profiling (#25683)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-05-26 11:24:27 +08:00
Chetan Kumar Verma 156d1af23a [Intel GPU] Fix incorrect KV-cache page table for local attention when page_size > 1 (#23757) 2026-05-26 11:02:21 +08:00
Mick 8f2a4e70f8 [SRT] minor: reuse req input id array for unpadded ids (#26232) 2026-05-26 08:58:32 +08:00
Liangsheng Yin 8805f4cf16 Fail-fast on PD subprocess exit and scheduler exception (#26298) 2026-05-25 16:42:50 -07:00
Ke Bao e7b12fe6fa Fix stale forward_metadata leak in DP attn unpadded idle batch (#26313) 2026-05-25 16:04:00 -07:00
Ziang Li 2b9dd9c8b3 [FlashInfer v0.6.10] [RL] [DSv32] [GLM-5] Add --dsa-topk-backend and integrate FlashInfer and pytorch topk (#22851) 2026-05-25 13:08:03 -07:00
Ke Bao b13d3d18c6 Refactor HiCache stack dispatch into strategies (#26295) 2026-05-26 00:06:17 +08:00
Shangming Cai 2aa6995308 [CI] Enable EPD CI for EPD architecture enhancements (#26281) 2026-05-25 23:52:58 +08:00