Add Intel Quantization Support in SGLang (#18139)
Signed-off-by: Mengni Wang <mengni.wang@intel.com> Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com> Co-authored-by: Peng Zhang <aniz1905@gmail.com> Co-authored-by: Ma Mingfei <mingfei.ma@intel.com> Co-authored-by: Weiwei <weiwei1.zhang@intel.com>
This commit is contained in:
co-authored by
Peng Zhang
Ma Mingfei
Weiwei
parent
10ff3c1dcb
commit
cfc0a0e0e0
@@ -139,6 +139,7 @@ fastokens = [
|
||||
test = [
|
||||
"accelerate",
|
||||
"addict",
|
||||
"auto-round>=0.13.1",
|
||||
"bitsandbytes",
|
||||
"diff-cover",
|
||||
"expecttest",
|
||||
|
||||
Reference in New Issue
Block a user