[Kimi] Support kimi-k3 (#32541)

Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Ziyi Xu <ziyi.xu@radixark.ai>
Co-authored-by: Zijie Xia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: zhangxiaohao <1024393531@qq.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: RolaoDenthu <xinyisong0111@gmail.com>
Co-authored-by: pigeonsoup <32922982+pigeonsoup@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
Co-authored-by: Lee Nau <lee.nau@gmail.com>
Co-authored-by: HMING <126185151+Hearum@users.noreply.github.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: BBuf <xiaoyu.zhang@radixark.ai>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
Co-authored-by: Xinyi Song <xinyis10@illinois.edu>

This commit is contained in:

Liangsheng Yin

2026-08-04 13:22:49 -07:00

committed by

GitHub

co-authored by

DarkSharpness

Xiaoyu Zhang

Mick

Yuhao Yang

Cheng Wan

Ke Bao

Baizhou Zhang

Chunan Zeng

Khoa Pham

Ziyi Xu

Zijie Xia

Yuwei An

zhangxiaohao

Yangmin Li

Julien Lin

Hao Phan

Thomas Wang

RolaoDenthu

pigeonsoup

HaiShaw

Xinyuan Tong

Pranjal Shankhdhar

Lee Nau

HMING

elvischenv

Byron Hsu

Claude Opus 5

Thomas Wang

Xinyi Song

Mohammad Miadh Angkad

Cheng Wan

BBuf

Hanming Lu

Xinyi Song

parent 0753663b8e

commit abddb1c7e9

139 changed files with 15414 additions and 911 deletions

									
										test/registered/unit/layers/quantization/test_mxfp4_sm90_cutlass.py
									
		+8
		
												View File
												
				@@ -48,6 +48,8 @@ from flashinfer.fused_moe import (

				)

				from flashinfer.fused_moe.core import ActivationType

				from sglang.srt.layers.moe.moe_runner.base import MoeRunnerConfig

				GROUP_SIZE = 32  # MXFP4 block size

				@@ -58,6 +60,12 @@ class _MockLayer:

				    path (``get_tp_group`` etc.).

				    """

				    def __init__(self):

				        # The SM90 weight-processing path reads the runner config for the

				        # gate/up row layout (``gate_up_interleaved``) and the activation. A

				        # real ``FusedMoE`` always carries one, so the stand-in does too.

				        self.moe_runner_config = MoeRunnerConfig()

				class _MockTopKOutput:

				    def __init__(self, weights, ids):