Commit Graph
27 Commits
Author SHA1 Message Date
Qi Yuhang 0368ddf9ea [JIT Kernel]Support fused_add_rmsnorm in JIT Kernel (#17677) 2026-01-29 09:29:59 +08:00
Xiaoyu Zhang c08b54a575 [JIT kernel] Update jit_kernel cache and develop doc (#17842) 2026-01-28 15:09:47 +08:00
Zhengbo Wang fb61164f27 [Refactor] Use is_in_ci() utility in JIT kernel benchmarks (#17118) 2026-01-25 20:40:47 +08:00
Xiaoyu Zhang 3992a023e6 Move fa4 from sgl-kernel to jit kernel (#17353) 2026-01-24 15:25:03 +08:00
Xiaoyu Zhang 7a4bb0d516 [Diffusion] Add diffusion time embedding to jit kernel (#17658) 2026-01-24 14:27:08 +08:00
Qi Yuhang 4c512a7d1d [JIT Kernel]Add Some CUDA Runtime API Wrapper for JIT Kernel Header (#17588) 2026-01-24 12:57:58 +08:00
Jinyan ChenandJinyan Chen e00b43442d [jit-kernel] Add CuTe DSL GDN Decode Kernel (#15631)
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
2026-01-18 12:54:36 -08:00
Michael 53609e5e5b Revert "[Diffusion] Move diffusion time embedding to jit kernel" (#17257) 2026-01-17 21:29:22 +08:00
Xiaoyu Zhang 2cdd4370bc [Diffusion] Move diffusion time embedding to jit kernel (#16879) 2026-01-17 12:21:22 +08:00
cctry dda35ccbd8 Fix gid calculation in per_tensor_absmax_kernel (#17126) 2026-01-15 23:21:41 +08:00
ba9f6d8f26 [Refactor] Clean up JIT kernel utilites (#16884)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-01-13 17:54:16 +08:00
Liangsheng YinandDarkSharpness 2b3791ed37 Fix wrong kernel selection for int32/int64 indices (#16912)
Co-authored-by: DarkSharpness <2040703891@qq.com>
2026-01-12 17:26:57 +08:00
DarkSharpness d112f6a25b [Feature] Support JIT set kv cache (#16273) 2026-01-10 17:34:09 -08:00
陈一涵 48b8dcd42e [jit kernel] support dtype as a cpp template parameter (#16452) 2026-01-08 13:54:33 +08:00
Xiaoyu Zhang 0fee6bc632 [JIT kernel] Apply jit per_tensor_quant_fp8 kernel (#15836) 2026-01-05 10:15:00 +08:00
DarkSharpness f6f7af4068 [Refactor] Clean up custom op (#15995) 2026-01-01 21:41:56 +08:00
DarkSharpness a3b1e8ef3d [Feature] add aligned_vector type for JIT kernel (#16162) 2026-01-01 21:40:05 +08:00
Yuan Luoandluoyuan.luo 3a42c5e341 [VLM] Adopt jit qk_norm kernel in VLM (#16171)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-01-01 10:10:36 +08:00
Xiaoyu Zhang 7d02c8e59f [JIT kernel] CI support jit kernel tests (#15939) 2025-12-28 23:11:02 +08:00
DarkSharpness 8e43980ebb [Feature] JIT Fused QK norm + qk norm clean up (#15835) 2025-12-28 11:53:50 +08:00
Xiaoyu Zhang de2f2880b5 [JIT sgl-kernel] Jit support per tensor quant (#15709) 2025-12-25 16:24:37 +08:00
Xuchun Shang fe712aa3df [bug fix] fix hicache jit kernel (#15177)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-12-24 10:31:21 +08:00
DarkSharpness 291f11ae39 [Minor] Enhance JIT kernel and add dev docs (#14570) 2025-12-23 22:34:59 +08:00
Liangsheng Yin a2423052f6 Add cuda event based on waiting value (#14214) 2025-12-01 18:51:44 +08:00
DarkSharpness ac5505b04c [Feature] HiCache JIT kernel (once again) (#13764) 2025-11-22 22:19:16 -08:00
Lianmin Zheng 7af9b88c6c Revert "[Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel)" (#13644) 2025-11-20 02:11:12 -08:00
DarkSharpness b51f9bbee7 [Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel) (#13453) 2025-11-20 00:03:32 -08:00