Add Intel Quantization Support in SGLang (#18139)

Signed-off-by: Mengni Wang <mengni.wang@intel.com>
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Weiwei <weiwei1.zhang@intel.com>
This commit is contained in:
Wang, Mengni
2026-06-26 09:54:35 +08:00
committed by GitHub
co-authored by Peng Zhang Ma Mingfei Weiwei
parent 10ff3c1dcb
commit cfc0a0e0e0
8 changed files with 259 additions and 2 deletions
+1
View File
@@ -139,6 +139,7 @@ fastokens = [
test = [
"accelerate",
"addict",
"auto-round>=0.13.1",
"bitsandbytes",
"diff-cover",
"expecttest",