sglang

compressed_tensors

[Tiny] Fix assert syntax warning in compressed_tensors_w4a4_mxint4_moe.py (#18899 )

2026-02-17 12:54:30 +08:00

configs

Refactor tuning block wise kernel and opt Qwen/Qwen3-VL-32B-Instruct-FP8 (#14141 )

2025-12-08 09:24:58 +08:00

modelslim

[3/N] Quantization Refactor: ModelSlim MoE schemes (#17993 )

2026-02-17 21:38:27 +03:00

quark

chore: fix some typos (#18577 )

2026-02-10 20:47:41 -08:00

__init__.py

Add mxfp8 support for online quantization, Triton dense linear, and CUTLASS MoE (#17449 )

2026-01-29 21:33:57 +08:00

auto_round.py

Fix circular import in quantization modules (#17372 )

2026-01-21 15:47:09 +08:00

awq_triton.py

Add AWQ quantization support for NPU. (#10158 )

2025-10-23 12:08:05 -07:00

awq.py

[NPU] NPU quantization refactoring & more quantization formats support (#14504 )

2026-01-15 04:25:15 +08:00

base_config.py

[NPU] NPU quantization refactoring & more quantization formats support (#14504 )

2026-01-15 04:25:15 +08:00

base_scheme.py

[2/N] Quantization Refactor: Compressed tensors MoE schemes (#17503 )

2026-02-16 18:03:51 +03:00

bitsandbytes.py

feat: support bitsandbytes quantization algorithm (#15325 )

2026-01-19 18:36:56 -08:00

blockwise_int8.py

[7/N] MoE Refactor: the implementation of new framework (#9269 )

2025-09-05 21:09:09 -07:00

fp4_utils.py

[Tiny] Backward compatibility for fp4 gemm flags (#17466 )

2026-01-21 14:34:40 +08:00

fp8_kernel.py

[AMD] rocm 7.2 image release, PR test, Nightly Test (#17799 )

2026-02-11 21:29:25 -08:00

fp8_utils.py

Tiny fix for fp8 moe backend flashinfer_trtllm naming (#18243 )

2026-02-04 19:58:04 +08:00

fp8.py

feat: [Qwen3.5] Support block-wise FP8 quantization and model adaptation (#18926 )

2026-02-18 11:44:25 +08:00

fpgemm_fp8.py

[lint] improve ruff check (#11922 )

2025-10-22 11:32:50 +08:00

gguf.py

[AMD] suppress warning for amd (#16620 )

2026-01-07 01:37:40 -08:00

gptq.py

[Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543 )

2026-02-13 22:29:22 +08:00

int8_kernel.py

chore: fix some typos (#18577 )

2026-02-10 20:47:41 -08:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730 )

2025-02-24 05:43:35 -08:00

kv_cache.py

Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode (#7725 )

2025-11-26 11:44:41 +08:00

kvfp4_tensor.py

feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078 )

2025-11-01 22:24:58 -07:00

marlin_utils_fp8.py

[Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543 )

2026-02-13 22:29:22 +08:00

marlin_utils.py

[Kernel] Migrate GPTQ-Marlin GEMM kernel to JIT (#18067 )

2026-02-06 08:31:42 +08:00

modelopt_quant.py

Fix modelopt FP8 create weights (#18447 )

2026-02-17 00:59:50 +08:00

moe_wna16.py

fix_get_quant_method_in_fused_moe_condition (#18459 )

2026-02-16 00:31:42 +08:00

mxfp4_tensor.py

[sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340 )

2025-08-27 12:01:30 -07:00

mxfp4.py

[Perf] ~9.5x faster Blackwell MXFP4 MoE weight loading (#18858 )

2026-02-16 19:47:09 +08:00

petit_utils.py

Support NVFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#7302 )

2025-07-18 19:59:39 -07:00

petit.py

Fix circular import in quantization modules (#17372 )

2026-01-21 15:47:09 +08:00

qoq.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989 )

2025-07-17 00:47:07 -07:00

quark_int4fp8_moe.py

[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392 )

2026-01-14 01:44:40 -08:00

rocm_mxfp4_utils.py

Optimized deepseek-v3/r1 model performance on mxfp4 run (#10008 )

2025-09-04 15:11:22 -07:00

unquant.py

[AMD] rocm 7.2 image release, PR test, Nightly Test (#17799 )

2026-02-11 21:29:25 -08:00

utils.py

Mistral Large 3 NVFP4 TRTLLM MoE support (#15049 )

2025-12-18 11:11:42 +08:00

w4afp8.py

Fix circular import in quantization modules (#17372 )

2026-01-21 15:47:09 +08:00

w8a8_fp8.py

[Fix] MoE: fix w8a8_fp8 MoE and add tests to cover this code path (#10429 )

2025-09-14 17:34:28 -07:00

w8a8_int8.py

[CPU][INT4] Add INT4 kernels for CPU (#8226 )

2026-01-29 22:30:13 -08:00