Yuan Luoandluoyuan.luo b7085d3860 [fp8] SM90 swap-AB scaled_mm dispatch (~1.16x kernel geomean, +5.8-18.5% end-to-end) (#25532) ...

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>

2026-05-20 13:20:37 +08:00

..

gptq

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

marlin

Revert "[Feature] NVFP4 Marlin fallback for non-Blackwell GPUs (SM75+… (#22047)

2026-04-03 13:12:30 -07:00

awq_kernel.cu

Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842)

2025-06-17 13:45:10 -07:00

bmm_fp8.cu

move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521)

2025-11-02 13:15:05 -08:00

dsv3_fused_a_gemm.cu

Enable PDL for various kernels in DSV32/GLM5 (#23965)

2026-05-09 03:42:56 -07:00

dsv3_router_gemm_bf16_out.cu

Enable PDL for various kernels in DSV32/GLM5 (#23965)

2026-05-09 03:42:56 -07:00

dsv3_router_gemm_entry.cu

[MUSA][8/N] Port CUDA kernels that are compatible with MUSA (#17946)

2026-04-23 18:04:58 -07:00

dsv3_router_gemm_float_out.cu

Enable PDL for various kernels in DSV32/GLM5 (#23965)

2026-05-09 03:42:56 -07:00

fp8_blockwise_gemm_kernel.cu

CUTLASS FP8 Blockwise GEMM improvement of SM120 (#20887)

2026-03-22 17:55:54 +08:00

fp8_gemm_kernel.cu

[fp8] SM90 swap-AB scaled_mm dispatch (~1.16x kernel geomean, +5.8-18.5% end-to-end) (#25532)

2026-05-20 13:20:37 +08:00

int8_gemm_kernel.cu

Optimize cutlass int8 gemm kernel for large M on SM89 Ada GPU (#10714)

2025-09-21 17:04:27 -07:00

math.hpp

[Perf] Tunings for SM100 FP8 CUTLASS kernel (#8818)

2025-08-13 21:59:22 -07:00

per_token_group_quant_8bit_v2.cu

Enable PDL for various kernels in DSV32/GLM5 (#23965)

2026-05-09 03:42:56 -07:00

per_token_group_quant_8bit.cu

Reland [1/2] Optimizations and refactors about quant kernel (#10312)

2025-10-11 15:59:03 +08:00

per_token_quant_fp8.cu

support smem in per_token_quant_fp8 kernel (#16725)

2026-02-02 17:18:50 +08:00

qserve_w4a8_per_chn_gemm.cu

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00

qserve_w4a8_per_group_gemm.cu

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00