Commit Graph
36 Commits
Author SHA1 Message Date
b6d7602914 [CPU] Add support for Gemma4 on Xeon (#22498)
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: Haotong Zou <haotong.zou@intel.com>
2026-08-17 10:52:26 +08:00
Xinyuan Tongandhnyls2002 85cdf1178d [CI] Prune redundant CPU test overhead (#34309)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-08-13 19:51:17 -07:00
fad376d3ee [CPU][QUANT] add amx cpu support for auto-round (#29593)
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>
Co-authored-by: sys-lpot-val <sys_lpot_val@intel.com>
Co-authored-by: Weiwei Zhang <WeiweiZhang1@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-13 15:50:59 +08:00
Xinguo Zhu 3f6ef01322 Optimize MiniMax-M2.7 on CPU (#31956) 2026-08-13 15:04:16 +08:00
Liangsheng Yin 9bd1461757 [CI] Bound the CUDA graph capture range in test launches and lift the spec fixture's admission cap (#33776) 2026-08-05 20:00:30 -07:00
Xiaoyu Zhang c32c4ef79c [Kernel] Move sgl-kernel under sglang.kernels.aot (#32648) 2026-07-29 17:25:00 +08:00
Chunyuan WU 60dea26077 [sgl-kernel][CPU] add kernel for shm_allgather_into_tensor and shm_reduce_scatter_tensor (#13397) 2026-07-23 09:19:38 +08:00
Ma MingfeiandCopilot Autofix powered by AI 878d77929d [CPU] refactor rope kernels (#31897)
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-07-22 09:12:02 +08:00
Mick d4801be447 fix: fix vlm cuda graph shape stability (#30868) 2026-07-19 22:35:51 +08:00
Ma Mingfei 486a56be56 [CPU] improve silu performance by replacing fp32 div with rcp14 (#31304) 2026-07-17 12:02:37 +08:00
Ma Mingfei 41e0b4b369 [CPU] add fused input proj for qwen3.5 (#31171) 2026-07-15 15:06:24 +08:00
Ma Mingfei 31548781e0 [CPU] bypass scoring_func argument in topk for cpu device (#31110) 2026-07-14 21:48:22 +08:00
Haotong Zou c124bec99d [CI] Disable gated Llama-2 EAGLE spec tests to unblock Xeon CPU CI (#30995) 2026-07-14 09:28:47 +08:00
Lianmin ZhengandAbhishek Parmar 4fcc994be1 Support priority request header override (#30811)
Co-authored-by: Abhishek Parmar <abhishek@orng.net>
2026-07-10 14:36:43 -07:00
Ma Mingfei 073b36853f [CPU] update fla.cpp to support when num_head_v is not multiples of 16 (#30604) 2026-07-10 09:21:07 +08:00
Mick 5ce5e1ee3e [Diffusion] Revert CPU AMX optimizations (#30716) 2026-07-10 09:09:38 +08:00
Haotong ZouandValentine233 3b43df5b6d Support speculative decoding on CPU (#27862)
Co-authored-by: Valentine233 <xuan.liao@intel.com>
2026-07-09 10:27:09 +08:00
jianan-guandMa Mingfei 177c048c68 [Diffusion][CPU] Adding AMX optimizations for CPU platform (#28527)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-07-09 10:26:22 +08:00
Ma Mingfei 30fb0dd851 [CPU] add fused_qk_gemma_norm and refactor norm kernel implementation (#30216) 2026-07-07 08:52:59 +08:00
Jialin Ouyang 40594bd381 [passthrough] engine: zstd request-body decompression + header overrides (#29684) 2026-06-30 23:48:56 -07:00
Ma Mingfei 3217410cf6 [CPU] enable fused_sigmoid_mul on CPU device (#29378) 2026-06-29 09:38:04 +08:00
Yibo Cai 4ce1c180bd [sgl-kernel/cpu]: fix arm64 w8a8 moe kernel signature (#29270) 2026-06-26 08:11:57 +08:00
Ma Mingfei 1ba7c79761 [CPU] add indices in chunk_gated_delta_rule (#29267) 2026-06-26 07:51:07 +08:00
Ma Mingfei 2c3f007a65 [CPU] optimize GDN prefill performance (#29117) 2026-06-25 09:04:34 +08:00
Mandepudi Rani Chowdary 7e3e616159 Add Arm64 INT8 MoE test coverage (#25007) 2026-06-10 10:36:57 +08:00
Zaili WangandMa Mingfei 3b7a258f63 [CPU] upgrade dependent torch ver to PT2.12 (#21456)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-06-04 11:04:11 +08:00
Teng Ma 544f3039d5 [PD] Fix IB device validation for JSON mappings (#26114) 2026-05-29 16:44:49 +08:00
blzheng a722b1a437 [CPU] fix incorrect index of b_ptr in fused_sigmoid_gating_delta_rule… (#26634) 2026-05-29 16:08:12 +08:00
3ecf2c76ad [CPU] Add GPT-OSS model optimization for CPU (#16775)
Co-authored-by: mingfeima <mingfei.ma@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-05-29 16:05:26 +08:00
Ma Mingfei 821d5f4a5b [CPU] add faster KV-cache writes (#25874) 2026-05-25 10:28:52 +08:00
84ea47eb22 [CPU] Fix issues when running llama3.2-11B vision model with image tasks (#8666)
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-05-21 13:09:18 +08:00
xutizhou 6a21dd20b1 Fix EPLB mapping for TopK paths (#25285) 2026-05-17 23:26:04 -07:00
Liangsheng Yin b7d62bd724 [CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420) 2026-05-15 18:26:55 -07:00
jundu 426dd339da Migrate Intel CPU cases to the test/registered (#25139) 2026-05-14 10:22:09 +08:00
Ma Mingfei 71285335f7 Revert "Migrate Intel CPU cases to the test/registered." (#25044) 2026-05-12 13:32:47 +08:00
jundu ecf5d844f5 Migrate Intel CPU cases to the test/registered. (#22670) 2026-05-12 13:27:51 +08:00