minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity
12,388 Commits 3 Branches 0 Tags
76a1f169b3c653d8bad4b3f1ceb0dcc207f183cc
Commit Graph
62 Commits
Author SHA1 Message Date
Xiaoyu Zhang 1360848ee1 Optimize large GroupNorm SiLU apply (#23938) 2026-05-02 20:54:46 +08:00
Qi Yuhangandgemini-code-assist[bot] 3f7c95d6cc [JIT Kernel][1/2]Migrate MXFP8 Group GEMM & Quant into JIT (#23833) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-29 22:50:09 +08:00
Cheng WanandClaude Opus 4.7 c7878dbb6d [MoE] Deprecate act_and_mul_triton; fold filter_expert into JIT silu/gelu_and_mul (#23707) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-26 01:41:35 -07:00
DarkSharpnessCheng WanCheng WanClaude Opus 4.7
 		82254bd9c5 [JIT Kernel] Reland JIT activation (#22094) 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-24 23:00:28 -07:00
DarkSharpnessandMingyang Jiang 314d6ecf08 [Feature][JIT Kernel] Fused TP QK norm For Minimax (#20673) 
Co-authored-by: Mingyang Jiang <13463932+jmydurant@users.noreply.github.com>
 2026-04-13 20:29:47 +08:00
Zhangheng 305b42935a [HiSparse]: Add benchmark for hisparse kernel (#22187) 2026-04-13 12:49:18 +08:00
Xiaoyu Zhang 82ea4906cf [diffusion] Default NVFP4 to CUTLASS and add all-model shape benchmarks (#22091) 2026-04-04 16:14:38 +08:00
Baizhou Zhang ac1e437f6a Revert "[Feature] JIT activation and update skills (by codex)" (#22078) 2026-04-03 15:04:15 -07:00
DarkSharpnessandweiminc 44e5d35703 [Feature][JIT Kernel] JIT activation and update skills (by codex) (#21766) 
Co-authored-by: weiminc <tnwilly@gmail.com>
 2026-04-03 23:28:54 +08:00
DarkSharpness 20f4193589 [Feature] JIT rmsnorm update (with claude) (#21834) 2026-04-01 23:40:00 +08:00
sglang-botsglang-botBaizhou Zhang
 		ca3ba05a7a chore: bump flashinfer version to 0.6.7 (#21422) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-31 21:18:16 -07:00
Brayden Zhong 6a9b09847c CUTLASS NVFP4 GEMM improvement of SM120 (#21314) 2026-04-01 09:04:34 +08:00
Johnsonms 5bbf347bb3 [jit_kernel] Optimize fused_qknorm_rope: deduplicate sincosf for interleave RoPE (#21654) 2026-04-01 09:04:13 +08:00
Xiaoyu Zhang cdd7d6a227 Remove obsolete sgl-kernel legacy paths (#21528) 2026-04-01 09:00:20 +08:00
Xiaoyu Zhang 9238bd08a2 [CI] Register missing jit_kernel test files (#21547) 2026-03-27 19:39:08 +08:00
Xiaoyu Zhang d633ab7349 [Diffusion] Add qknorm rope fuse kernel (#21440) 2026-03-27 14:27:08 +08:00
Johnsonms 8a56a7b04d [jit_kernel] Migrate cast (downcast_fp8) from sgl-kernel AOT to JIT (#19103) 2026-03-27 13:21:44 +08:00
JohnsonmsandXiaoyu Zhang c531be455e [jit_kernel] Add fused_qknorm_rope JIT kernel (#19059) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-03-27 13:21:28 +08:00
Xiaoyu Zhang 7ca015fe65 [Diffusion] Refactor diffusion JIT kernel test layout and narrow CI triggers (#21385) 2026-03-26 15:02:02 +08:00
Lianmin Zheng 260abe1fb1 Refactor JIT kernel CI to use run_suite.py registration system (#21239) 2026-03-23 21:17:27 -07:00
Xiaoyu Zhangandgemini-code-assist[bot] c1fe5de69c [Diffusion] Clean up diffusion Triton kernels and modernize custom op registration (#21122) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-22 22:38:57 +08:00
Xiaoyu ZhangandMick 1b65c0d259 [Diffusion] Fix torch.compile RMSNorm fallback for Z-Image (#20962) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-22 15:38:22 +08:00
Lianmin ZhengandClaude Opus 4.6 76e4a8662c Replace clamp_position with JIT kernel + platform dispatch (#20999) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-21 21:26:26 -07:00
Xiaoyu Zhang c076968c52 [CI] Remove obsolete AOT-only jit-kernel benchmarks after sgl-kernel 4.0 (#21075) 2026-03-21 13:40:42 +08:00
Lianmin Zheng 104b10f70a refactor: consolidate is_in_ci (jit_kernel, sgl-kernel benchmarks, tests) (#21009) 2026-03-20 05:55:36 -07:00
DarkSharpnessandXiaoyu Zhang 2dd9196079 [JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-03-20 18:24:07 +08:00
Lianmin ZhengandClaude Opus 4.6 112b628227 Replace _resolve_future_token_ids with JIT kernel + platform dispatch (#20976) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-20 01:47:03 -07:00
xingsy97 f78d5c3b3c [JIT Kernel] Add hadamard kernel test and benchmark (#20030) 2026-03-17 23:16:35 -07:00
Xiaoyu ZhangandBaizhou Zhang 15097c5c3b Release sglang kernel 0.4.0 (#20440) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-16 20:34:58 +08:00
Xiaoyu Zhang e1eb25880f [Diffusion] Add a benchmark for rmsnorm/fuse_add_rmsnorm (#20632) 2026-03-16 09:50:33 +08:00
Xiaoyu Zhang 25e38216b6 [kernel slimming] Clean many useless sgl-kernel deprecated kernels (#20277) 2026-03-14 16:45:54 +08:00
Xiaoyu ZhangandYihan Chen e00328d1e5 [Diffusion] Opt qwen-image-edit with fuse_residual_layernorm_scale_shift_gate_select01_kernel (#20395) 
Co-authored-by: Yihan Chen <yingluosanqian@gmail.com>
 2026-03-13 13:15:22 +08:00
Xiaoyu Zhang 60cc06297e [4/n jit_kernel restruct] speed up CI tests and add benchmark workflow (#20268) 2026-03-10 21:37:41 +08:00
Xiaoyu Zhang 51d9d34977 [2/n jit_kernel restruct] unify rotary embedding entrypoints under rope.py (#20247) 2026-03-10 17:49:57 +08:00
Xiaoyu Zhang 8517da5d08 [3/n jit_kernel restruct] Clean up benchmark naming and benchmarking helpers (#20250) 2026-03-10 16:39:03 +08:00
Johnsonms 7cf0551014 Migrate norm kernels to FlashInfer JIT implementation (#18871) 2026-03-10 14:56:07 +08:00
Mohammad Miadh Angkad f88acf8780 [JIT Kernel] Reland NVFP4 kernels to JIT (#20012) 2026-03-07 10:31:08 +08:00
Johnsonms 2d266c73ea Migrate renorm kernels from sgl-kernel to FlashInfer JIT (#18854) 2026-03-06 22:53:28 +08:00
Baizhou Zhang 51e5dc845a Revert "[Kernel Slimming] Migrate NVFP4 kernels to JIT" (#20005) 2026-03-05 19:40:00 -08:00
Mohammad Miadh Angkad 2bdd89a6cd [Kernel Slimming] Migrate NVFP4 kernels to JIT (#19437) 2026-03-05 15:22:28 +08:00
Yuan Luoluoyuan.luoMohammad Miadh Angkad
 		7c9e8e2def [Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
 2026-02-26 09:53:57 +08:00
Linyu WuandXiaoyu Zhang beabaa8d37 [Kernel Slimming] Migrate marlin moe kernel to JIT (#19181) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-26 09:05:13 +08:00
Hubert LuandCursor 8bd644765f [AMD] Enable ROCm kvcache JIT path and add AMD CI coverage. (#18992) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-25 14:15:05 +08:00
Linyu WuandXiaoyu Zhang 2cdde5d4ab [Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-23 22:05:27 +08:00
Liangsheng Yin 4653939cda Revert "[jit kernel] Support per_token_group_quant_8bit jit kernel" (#19131) 2026-02-22 07:54:24 +08:00
DarkSharpnessandgemini-code-assist[bot] d8d0208c63 [Feature] rewrite rope kernel; remove flashinfer dependencies (#18844) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-21 21:32:40 +08:00
Yuan Luoandluoyuan.luo 7d953440ec [jit kernel] Support per_token_group_quant_8bit jit kernel (#18905) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-02-20 21:01:05 +08:00
DarkSharpness 9d138685c1 [Refactor] Fix test and clean up hicache code (#18555) 2026-02-18 14:37:46 +08:00
Yi Zhong ed22720c07 [JIT kernel] hd=512,1024 in JIT QK norm (cta based) (#17515) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2026-02-16 16:07:24 +08:00
Linyu WuandXiaoyu Zhang 0012d6a4eb [Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-13 22:29:22 +08:00