3 people 11d03eaeef runtime: Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120- #32994 (#33471) ...

Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>

2026-08-09 20:15:03 +08:00

..

all_gather

[AMD] Enable AITER custom all-gather on ROCm (#25093)

2026-06-02 15:57:37 -07:00

all_reduce

[AMD] Add fused all-reduce RMSNorm per-group quant for Qwen3.5 FP8 (#24651)

2026-07-22 07:33:03 -07:00

attention

[Kernel] Add inventory guards and clean benchmark layout (#32788)

2026-07-30 09:03:24 +08:00

decoding_attention_triton

[Kernel] Relocate vendored fla and mamba kernel trees to sglang.kernels (RFC #29630, Phase 2.5, 7/7) (#30795)

2026-07-15 12:52:15 +08:00

deepep

Add CLI args to conveniently support tuning more models (#12922)

2026-03-12 23:10:55 -07:00

deepseek

[DSA] Q8KV8 FP8 Sparse Prefill on GLM-5.2 & DeepSeek-V3.2: Q8-Path & Shared-Path Optimizations (#31888)

2026-07-30 15:15:11 +08:00

elementwise

[Benchmark] use flashinfer bench_gpu_time instead of triton do_bench (#20305)

2026-03-12 04:04:30 +00:00

flashinfer_allreduce_fusion

Refactor FP4 quantization and remove deprecated JIT kernels (#30448)

2026-07-14 09:22:07 +08:00

fused_moe_triton

[Model] Add support for JetBrains' Mellum v2 code generation model (#27375)

2026-07-13 22:54:38 -07:00

lora_csgmv

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)

2026-07-10 21:41:08 +08:00

quantization

Refactor FP4 quantization and remove deprecated JIT kernels (#30448)

2026-07-14 09:22:07 +08:00

scheduler_batch

[Benchmark] use flashinfer bench_gpu_time instead of triton do_bench (#20305)

2026-03-12 04:04:30 +00:00

sliding_window_attention_triton

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)

2026-07-10 21:41:08 +08:00

verify_splitkv_triton

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)

2026-07-10 21:41:08 +08:00

bench_fused_gate_sigmoid_mul_add.py

[Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630) (#32148)

2026-07-23 13:47:02 +08:00

bench_fused_rmsnorm_fp8_quant.py

runtime: Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120- #32994 (#33471)

2026-08-09 20:15:03 +08:00

bench_fused_sigmoid_mul.py

[Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630) (#32148)

2026-07-23 13:47:02 +08:00