sglang

compressed_tensors

[AMD] Add MoE weights and scales padding (#21097 )

2026-04-13 15:50:15 -07:00

configs

Fix result writer in tuning_block_wise_kernel.py, and add FP8 kernel config for L40 (#20368 )

2026-03-20 09:28:54 +08:00

modelslim

[Bugfix] [NPU] Qwen3.5 with quantization fix (#21692 )

2026-04-08 09:15:48 +03:00

quark

[AMD] Add MoE weights and scales padding (#21097 )

2026-04-13 15:50:15 -07:00

__init__.py

Revert "feat: Support MXFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#19143 )" (#23031 )

2026-04-16 21:53:25 -07:00

auto_round.py

[Feature][NPU]: add runtime support for AutoRound quantized models (#16699 )

2026-03-07 18:03:55 +03:00

awq_triton.py

Add AWQ quantization support for NPU. (#10158 )

2025-10-23 12:08:05 -07:00

awq.py

Piecewise Cuda Graph set default (#16331 )

2026-03-02 23:18:07 +08:00

base_config.py

[Lora] Lora quat info re-factor and support deepseekv3 mla lora (#22323 )

2026-04-09 14:19:58 -07:00

base_scheme.py

[2/N] Quantization Refactor: Compressed tensors MoE schemes (#17503 )

2026-02-16 18:03:51 +03:00

bitsandbytes.py

[misc] clean up kernel API (#21325 )

2026-03-25 09:10:23 +08:00

blockwise_int8.py

[Lora] Lora quat info re-factor and support deepseekv3 mla lora (#22323 )

2026-04-09 14:19:58 -07:00

fp4_utils.py

CUTLASS NVFP4 GEMM improvement of SM120 (#21314 )

2026-04-01 09:04:34 +08:00

fp8_kernel.py

[Kernel] Set sgl_per_token_group_quant_8bit_v2 as default choice (#22467 )

2026-04-11 01:59:57 -07:00

fp8_utils.py

perf: optimize PCG inductor path for FP8 models (#21734 )

2026-04-14 17:51:27 +08:00

fp8.py

[AMD] Add MoE weights and scales padding (#21097 )

2026-04-13 15:50:15 -07:00

fpgemm_fp8.py

[lint] improve ruff check (#11922 )

2025-10-22 11:32:50 +08:00

gguf.py

Revert "[Feature] JIT activation and update skills (by codex)" (#22078 )

2026-04-03 15:04:15 -07:00

gptq.py

[Feature][NPU]: add runtime support for GPTQ-quantized MoE models (#16364 )

2026-03-04 16:02:19 +03:00

int8_kernel.py

chore: fix some typos (#18577 )

2026-02-10 20:47:41 -08:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730 )

2025-02-24 05:43:35 -08:00

kv_cache.py

Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode (#7725 )

2025-11-26 11:44:41 +08:00

kvfp4_tensor.py

feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078 )

2025-11-01 22:24:58 -07:00

marlin_utils_fp8.py

[misc] clean up kernel API (#21325 )

2026-03-25 09:10:23 +08:00

marlin_utils.py

fix: remove duplicate words in comments (#22007 )

2026-04-03 00:05:39 -07:00

modelopt_quant.py

[RL] Refactor NVFP4 shuffling/swizzling to in-place replacement (#22204 )

2026-04-12 19:08:45 -07:00

moe_wna16.py

[Lora] Lora quat info re-factor and support deepseekv3 mla lora (#22323 )

2026-04-09 14:19:58 -07:00

mxfp4_tensor.py

[sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340 )

2025-08-27 12:01:30 -07:00

mxfp4.py

Fix SM120 triton_kernels MXFP4 block_k for GPT-OSS (#20040 )

2026-03-06 10:53:08 -08:00

petit_utils.py

Revert "feat: Support MXFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#19143 )" (#23031 )

2026-04-16 21:53:25 -07:00

petit.py

Revert "feat: Support MXFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#19143 )" (#23031 )

2026-04-16 21:53:25 -07:00

qoq.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989 )

2025-07-17 00:47:07 -07:00

quark_int4fp8_moe.py

[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392 )

2026-01-14 01:44:40 -08:00

rocm_mxfp4_utils.py

Optimized deepseek-v3/r1 model performance on mxfp4 run (#10008 )

2025-09-04 15:11:22 -07:00

unquant.py

[Intel GPU] Enable sgl-kernel-xpu fused_experts MoE kernel path for GPT-OSS bf16 models. (#22417 )

2026-04-13 13:45:48 +08:00

utils.py

[RL] Support per-layer mixed FP8/BF16 serving for FP8 checkpoints (#18742 )

2026-03-01 21:59:22 +08:00

w4afp8.py

[Reland] DeepSeek-R1-0528-w4a8: DeepEP Low Latency Dispatch Adopts FP8 Communication (#22316 )

2026-04-10 14:56:05 +08:00

w8a8_fp8.py

[Lora] Lora quat info re-factor and support deepseekv3 mla lora (#22323 )

2026-04-09 14:19:58 -07:00

w8a8_int8.py

[Lora] Lora quat info re-factor and support deepseekv3 mla lora (#22323 )

2026-04-09 14:19:58 -07:00