sglang

compressed_tensors

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

configs

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220 )

2025-03-11 12:32:33 -07:00

deep_gemm_wrapper

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

quark

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

__init__.py

Enable native ModelOpt quantization support (1/3) (#7149 )

2025-10-06 13:24:15 -07:00

awq_triton.py

[AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661 )

2025-07-18 14:27:25 -07:00

awq.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

base_config.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

blockwise_int8.py

[7/N] MoE Refactor: the implementation of new framework (#9269 )

2025-09-05 21:09:09 -07:00

fp8_kernel.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

fp8_utils.py

move more files under srt/utils (#11285 )

2025-10-09 16:46:15 -07:00

fp8.py

[8/N] MoE Refactor: deprecate EPMoE (#11211 )

2025-10-07 21:51:41 -07:00

fpgemm_fp8.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

gptq.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

int8_kernel.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730 )

2025-02-24 05:43:35 -08:00

kv_cache.py

[refactor] slightly tidy fp8 module (#5993 )

2025-05-07 17:28:24 -07:00

marlin_utils_fp8.py

[5/n]decouple quantization implementation from vLLM dependency (#9454 )

2025-08-21 12:52:07 -07:00

marlin_utils.py

[5/n]decouple quantization implementation from vLLM dependency (#9454 )

2025-08-21 12:52:07 -07:00

modelopt_quant.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

moe_wna16.py

[7/N] MoE Refactor: the implementation of new framework (#9269 )

2025-09-05 21:09:09 -07:00

mxfp4_tensor.py

[sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340 )

2025-08-27 12:01:30 -07:00

mxfp4.py

Depreate global_server_args_dict (#11528 )

2025-10-13 19:34:43 +08:00

petit_utils.py

Support NVFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#7302 )

2025-07-18 19:59:39 -07:00

petit.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

qoq.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989 )

2025-07-17 00:47:07 -07:00

rocm_mxfp4_utils.py

Optimized deepseek-v3/r1 model performance on mxfp4 run (#10008 )

2025-09-04 15:11:22 -07:00

unquant.py

[Bugfix] Qwen3MoE aclrtMemcpy failed with NPUGraph (#10013 )

2025-09-07 21:50:49 -07:00

utils.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

w4afp8.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

w8a8_fp8.py

[Fix] MoE: fix w8a8_fp8 MoE and add tests to cover this code path (#10429 )

2025-09-14 17:34:28 -07:00

w8a8_int8.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00