Commit Graph
18707 Commits
Author SHA1 Message Date
Yuan Luoandluoyuan.luo c7adca9992 Fix kimi-linear launch server error (#21752)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-03-31 21:07:08 +08:00
Ke Bao dbc97456ad Enable evict swa with piecewise cuda graph (#21754) 2026-03-31 20:07:16 +08:00
Ke Bao 91ab75b505 [CI] Fix ring test timeout (#21751) 2026-03-31 18:26:08 +08:00
weireweireandWeiliangl User 4455d17619 [PD] Refactor Disagg Conn and Fix Hang with total_request/total_tokens Balancing (#21299)
Co-authored-by: Weiliangl User <weiliangl@login-node.hosted.internal>
2026-03-31 18:01:50 +08:00
Ke Bao acd37d8701 [CI] Fix rerun-test suite detection to skip commented registrations (#21753) 2026-03-31 18:00:53 +08:00
R0CKSTAR 6c03ae6fe2 [diffusion] fix: fix typo (#21746)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-03-31 17:51:46 +08:00
xiaoqiandxiaoqi.31 a6a8b9b376 bugfix(model):fix deepstack index out of range error (#21727)
Co-authored-by: xiaoqi.31 <xiaoqi.31@jd.com>
2026-03-31 02:41:47 -07:00
Ke Bao 2456889f98 Rename rerun-ut to rerun-test (#21747) 2026-03-31 17:31:55 +08:00
Ke Bao 08d3c1a134 Fix disaggregation hybrid attention ci (#21745) 2026-03-31 16:22:54 +08:00
Baizhou Zhang d52757fe97 [CI]Remove msgm-en and mmlu tests which cause timeout (#21733) 2026-03-31 01:10:05 -07:00
Thomas Wang 5628e908ae [AMD] Use tgemm.mm for MoEGate router gemm in deepseek_v2.py (#21657) 2026-03-31 00:55:40 -07:00
xiazhahe b4cb31f698 [NPU] fix conflict between empty_cache and use_mem_pool (#21507) 2026-03-31 15:37:33 +08:00
Mohammad Miadh Angkad dd9c9c1b8e Add explicit disable flag for FlashInfer allreduce fusion (#21446) 2026-03-31 00:15:44 -07:00
Yuhao Yang 68a4573627 [diffusion] fix: fix Flux.2 with tp(#21664) 2026-03-31 14:14:59 +08:00
jacky.cheng 8ba992411d [AMD] Fix CI multimodal-gen-test-1-gpu-amd for gen model (#21621) 2026-03-30 23:02:20 -07:00
Jincong Chen 03e4f2858d [Perf]Remove H2D for Qwen3.5 SpecV2 (#20864) 2026-03-31 11:54:58 +08:00
Lewisand百麒 33e725b052 [Fix] Update supported custom_mem_pool types for mooncake (#21728)
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
2026-03-31 11:18:30 +08:00
Xiaoyu Zhang 505eb312ec Revert "DeepSeek-R1-0528-w4a8: DeepEP Low Latency Dispatch Adopts FP8 Communication" (#21719) 2026-03-31 10:22:01 +08:00
Alison ShaoandAlison Shao 9b6bee2d40 Fix human-eval CI install on 5090 runners (#21714)
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
2026-03-30 18:53:09 -07:00
DarkSharpness 4e480982fa [misc] multiprocess compilation to speed up test (#21483) 2026-03-31 08:56:37 +08:00
Alison ShaoandAlison Shao 3650bfb199 Remove flashinfer wheel cache cleanup that deletes other versions (#21711)
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
2026-03-30 16:47:04 -07:00
kk 67c295b5f5 [AMD] fix performance regression issue when run gpt-oss with "--context-length 13824" (#21691) 2026-03-30 16:30:16 -07:00
jhchouuu 4b8456e266 [AMD][MoRI] bump MoRI to v0.1.0 (#21673) 2026-03-30 14:44:11 -07:00
Zhai FeiyueandHaiShaw daf697afda [AMD] Add SGLANG_DISAGGREGATION_NUM_PRE_ALLOCATE_REQS env var for configurable KV transfer overlap (#20410)
Co-authored-by: HaiShaw <hixiao@gmail.com>
2026-03-30 14:37:16 -07:00
d6029de6ad [Bugfix][NPU] Skip FRACTAL_NZ format for MoE weights with unaligned dimensions (#21209)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-03-30 23:22:17 +03:00
Vedant V Jhaveri 4a9ffc3ab6 fix nemotron capture for non attention layers (#21436) 2026-03-30 12:50:49 -07:00
Yuxuan Zhang ad064c2f4e [GLM-V and GLM-4.7] Cast to FP32 before gate projection for GLM model. (#21660) 2026-03-30 12:25:27 -07:00
yuefeng Wuandgemini-code-assist[bot] a20d12ae96 [diffusion][doc]: add ring sp performance benchmark page (#20998)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-03-30 20:26:05 +03:00
Makcum888e f4b0e9c64a [diffusion] [NPU] support ring attention on NPU with FA (#21383) 2026-03-30 20:10:55 +03:00
GXINand高鑫 752d260c77 [NPU][diffusion]: support parallel decoding of qwen-image (#20757)
Co-authored-by: 高鑫 <gaoxin@gaoxindeMacBook-Pro.local>
2026-03-30 20:03:24 +03:00
cen121212 ba6d54d0f0 [NPU] GLM-5 optimize with fused kernels (#18617) 2026-03-30 22:48:15 +08:00
xieminghe1andundefined 7119d59747 DeepSeek-R1-0528-w4a8: DeepEP Low Latency Dispatch Adopts FP8 Communication (#14162)
Co-authored-by: undefined <zhouchen.arrebol@jd.com>
2026-03-30 22:27:28 +08:00
heziiop 673ffb3116 [NPU] fix eagle3 accept rate (#21255) 2026-03-30 21:58:25 +08:00
GXINand高鑫 c5c58c3349 [NPU][Diffusion] fix sp modulate for qwen-image-edit (#20974)
Co-authored-by: 高鑫 <gaoxin@gaoxindeMacBook-Pro.local>
2026-03-30 16:18:48 +03:00
Mick 0a1fb42869 [diffusion] CI: relax pr-test threshold (#21682) 2026-03-30 20:23:46 +08:00
Mick b76730701b [diffusion] feat: enhance overlay mechanism (#21648) 2026-03-30 19:45:34 +08:00
1d6424d5ad fix: Mistral Small 4 fails to start due to config/weight format mismatch (#21620)
Co-authored-by: mengxiancheng03 <mengxiancheng03@kuaishou.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 01:57:35 -07:00
strgrb b246269444 fix mamba cache leak when adder fails to add a matched req. (#21404) 2026-03-30 16:45:49 +08:00
Baizhou ZhangandClaude Opus 4.6 62a63eeff7 [Fix] Fix weight_loader property assignment for qwen3-next FP8 models (#21662)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 01:35:59 -07:00
Hubert Lu e6071e60c0 [AMD] Support AMD MXFP4 Qwen3.5-397B-A17B model (#21234) 2026-03-30 01:14:18 -07:00
Michelle Wuandwuxue 965f03cdc2 [NPU] Update DeepSeek-V3.2 model deployment instructions in documentation (#21468)
Co-authored-by: wuxue (C) <w00964934@china.huawei.com>
2026-03-30 15:51:42 +08:00
kkandwunhuang b9a68c304e [AMD] Fused rope kv store (#21315)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-03-30 00:05:41 -07:00
Ma Mingfei af62bd9486 [CPU] Implement MXFP4 Gemm kernels for intel AMX to support GPT OSS series. (#14385) 2026-03-29 23:44:12 -07:00
blzhengandMa Mingfei ed01e1d5d6 [CPU] add kernel apply_rotary_pos_emb_cpu for Qwen3-VL and Qwen3-Omni (#13121)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-03-29 23:43:46 -07:00
Ma Mingfei 6da8f5f69e fix topk softmax performance issue (#14702) 2026-03-29 23:43:16 -07:00
Aishwarya Ramasethu c32ee48886 MFU metrics in Prometheus (#19395) 2026-03-29 23:40:06 -07:00
Ziang Li 1a4b383fac [CI] [FlashInfer v0.6.7] Use offline quantized checkpoint for MXFP8 Gemm tests (#21625) 2026-03-29 22:47:46 -07:00
Baizhou Zhangandgemini-code-assist[bot] 5b19c9a05d [Doc] Update tips for developer new-comers (#21659)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-03-29 22:40:36 -07:00
Polisetty V R K Jyothendra Varma f0303fd07e [Intel GPU] Enable DeepSeek R1 inference on XPU (#18461)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
2026-03-29 22:35:59 -07:00
Kangyan-ZhouandClaude Opus 4.6 d8ab41dce5 [Fix] Handle pre-release tags in nightly wheel version parsing (#21656)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 22:29:40 -07:00