Commit Graph
70 Commits
Author SHA1 Message Date
Xinguo Zhu cc012abd21 [CI] fix CI regression on xeon (#41002) 2026-09-28 10:28:01 +08:00
Liangsheng Yin 516ab77619 [Test] Route all sgl-eval benchmarks through run_sgl_eval and deprecate run_eval (#41280) 2026-09-25 15:48:38 -07:00
Liangsheng Yin 78980a3b0b [misc] Remove deprecated endpoints, env vars and aliases past two releases (#40795) 2026-09-22 18:14:45 -07:00
Cheng Wan 2d0e94e3a3 Check the topology identities where the layout is written, and build at the published widths (#40340) 2026-09-21 12:22:59 -07:00
HuangJi 2a0cb2f04e [Diffusion][MiniMax-H3] Add SM120 Sage compute for SubBlock sparse attention (#40116) 2026-09-20 16:40:28 +08:00
Liangsheng Yin f65c70bb7d [Kernel] Move CUDA and ROCm speculative kernels to JIT (#40033) 2026-09-17 17:27:26 -07:00
Xinguo ZhuandAKatydid 4678536df6 [CPU] Add fp8_per_tensor_scaled_mm_cpu kernel (#32618)
Co-authored-by: AKatydid <xinguojoe@gmail.com>
2026-09-16 12:31:05 +08:00
Cui Lily e687b8d6af [CPU] Implement fused QK Norm and RoPE kernels (#37748)
Signed-off-by: Cui, Lily <lily.cui@intel.com>
2026-09-15 14:17:57 +08:00
Cheng Wan f1a512c51c [Config] msgspec.Struct for the config tier (#38753) 2026-09-09 19:41:19 -07:00
HuangJi ffe98a4279 [Diffusion][MiniMax-H3] Add SM90 Sage compute for SubBlock sparse attention (#37982) 2026-09-09 20:00:03 +08:00
Cheng Wan db272201a2 [Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375) 2026-09-08 16:42:12 -07:00
Xiaoyu ZhangandMick Qian 4d23a4fa6d [Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-07 15:13:59 +08:00
Ma Mingfei 6a1ff90f2d [CPU] use CustomTestCase for registered CPU tests (#38244) 2026-09-07 15:09:52 +08:00
Yuxingwang-intelandMa Mingfei 707da81e84 [CPU] Add native CPU kernel for MurmurHash32 (#35604)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-09-07 09:10:35 +08:00
junduandMa Mingfei 8770c1db1f [CPU][CI]: rename Xeon CPU CI suites to stage-*-intel (#37395)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-09-04 10:08:41 +08:00
Quanli Liand全力 4e37882a93 [Diffusion][minimax-h3] Add SM120 support for SubBlock sparse attention (#37332)
Co-authored-by: 全力 <liquanli.lql@antgroup.com>
2026-09-03 22:05:22 +08:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-09-02 19:46:08 -07:00
26f760d5c0 [CPU] Support FP8 KV cache (#32733)
Co-authored-by: Zheng, Beilei <beilei.zheng@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
2026-09-02 10:20:54 +08:00
Cheng WanandClaude Opus 5 f0d621cfa6 config: the dead record parameters go (#36974)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-29 04:20:55 -07:00
Cheng WanandClaude Opus 5 b65e677e48 config: the resolution callbacks into the record go to zero (#36972)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-29 04:18:05 -07:00
Chunyuan WU 92b0d447b0 [CPU] Fix wrongly causal-masked bidirectional attention (#35434) 2026-08-28 19:49:43 -07:00
Cheng WanandClaude Opus 5 ef20fab38a config: the forwarding slots go; the dispatcher calls the family directly (#36792)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:26:29 -07:00
Cheng WanandClaude Opus 5 c2928e86d7 config: the resolution pipeline moves out of the record (#36789)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:17:24 -07:00
b294bd4bc7 [CPU][CI]: fix a few issues that cause XEON CI failures (#36413)
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
2026-08-27 13:59:08 +08:00
Cheng Wan 413df1f8db config: ServerArgs holds the raw input (#36255) 2026-08-26 05:14:05 -07:00
HuangJi cc3b61873f [Diffusion][minimax-h3] Restrict MiniMax-H3 SubBlock sparsity to video queries (#35850) 2026-08-26 10:55:09 +08:00
MingxuZhandClaude b7f9fca26e [CPU] Raise mem-fraction-static 0.1->0.2 in intel_amx backend a/b (#36260)
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-25 14:36:20 +08:00
Chunyuan WU 1daa94a069 [CPU] Fix NUMA/core binding for DP ranks (#32856) 2026-08-24 12:15:38 +08:00
514b997e6c Register CPU CI for 17 e2e tests and partition xeon base-c suite (#35227)
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-24 10:49:38 +08:00
YanbingJiang fd73d4b019 [CPU] Add graph register for fused_sigmoid_mul_cpu, fused_qk_gemma_rmsnorm (#35506) 2026-08-24 10:18:57 +08:00
Chao Shi 2ef0fe4669 TP/PP Consensus checker (#34406) 2026-08-21 01:36:03 +08:00
HuangJi ee1f2e8dfd [diffusion][Minimax H3]support subblock sparse attention on SM90 (#34680) 2026-08-19 10:31:45 +08:00
Chunyuan WU 58c5bee3ac Fix DP attention on CPU (#12961) 2026-08-19 09:56:21 +08:00
Ma Mingfei 7f51e6bba0 [CPU] Explicitly import sgl_kernel in CPU kernel tests (#35119) 2026-08-18 10:20:28 +08:00
b6d7602914 [CPU] Add support for Gemma4 on Xeon (#22498)
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: Haotong Zou <haotong.zou@intel.com>
2026-08-17 10:52:26 +08:00
Xinyuan Tongandhnyls2002 85cdf1178d [CI] Prune redundant CPU test overhead (#34309)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-08-13 19:51:17 -07:00
fad376d3ee [CPU][QUANT] add amx cpu support for auto-round (#29593)
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>
Co-authored-by: sys-lpot-val <sys_lpot_val@intel.com>
Co-authored-by: Weiwei Zhang <WeiweiZhang1@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-13 15:50:59 +08:00
Xinguo Zhu 3f6ef01322 Optimize MiniMax-M2.7 on CPU (#31956) 2026-08-13 15:04:16 +08:00
Liangsheng Yin 9bd1461757 [CI] Bound the CUDA graph capture range in test launches and lift the spec fixture's admission cap (#33776) 2026-08-05 20:00:30 -07:00
Xiaoyu Zhang c32c4ef79c [Kernel] Move sgl-kernel under sglang.kernels.aot (#32648) 2026-07-29 17:25:00 +08:00
Chunyuan WU 60dea26077 [sgl-kernel][CPU] add kernel for shm_allgather_into_tensor and shm_reduce_scatter_tensor (#13397) 2026-07-23 09:19:38 +08:00
Ma MingfeiandCopilot Autofix powered by AI 878d77929d [CPU] refactor rope kernels (#31897)
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-07-22 09:12:02 +08:00
Mick d4801be447 fix: fix vlm cuda graph shape stability (#30868) 2026-07-19 22:35:51 +08:00
Ma Mingfei 486a56be56 [CPU] improve silu performance by replacing fp32 div with rcp14 (#31304) 2026-07-17 12:02:37 +08:00
Ma Mingfei 41e0b4b369 [CPU] add fused input proj for qwen3.5 (#31171) 2026-07-15 15:06:24 +08:00
Ma Mingfei 31548781e0 [CPU] bypass scoring_func argument in topk for cpu device (#31110) 2026-07-14 21:48:22 +08:00
Haotong Zou c124bec99d [CI] Disable gated Llama-2 EAGLE spec tests to unblock Xeon CPU CI (#30995) 2026-07-14 09:28:47 +08:00
Lianmin ZhengandAbhishek Parmar 4fcc994be1 Support priority request header override (#30811)
Co-authored-by: Abhishek Parmar <abhishek@orng.net>
2026-07-10 14:36:43 -07:00
Ma Mingfei 073b36853f [CPU] update fla.cpp to support when num_head_v is not multiples of 16 (#30604) 2026-07-10 09:21:07 +08:00
Mick 5ce5e1ee3e [Diffusion] Revert CPU AMX optimizations (#30716) 2026-07-10 09:09:38 +08:00