Commit Graph
10 Commits
Author SHA1 Message Date
Peng Zhang 719b29f218 feat: enchance green context stream creation robust with backward compatibility (#8136) 2025-07-18 02:45:03 -07:00
Peng Zhang c28ad1990d [1/n] chore: decouple quantization implementation from vLLM dependency (#7992) 2025-07-16 15:56:26 -07:00
Peng Zhang 6dc4af4937 fix greenctx stream compability (#8090) 2025-07-16 07:08:46 -07:00
Peng Zhang b5dd5e8741 chore: remove unnecessary limits on quantization methods in test script (#7997) 2025-07-13 16:11:49 -07:00
Peng Zhang 191d836ff6 fix: minor fix for modelopt weight load compatibility (#7953) 2025-07-11 14:20:58 -07:00
AniZpZ b58226510f fix dsv3 fused proj check (#7738) 2025-07-03 01:52:44 -07:00
AniZpZ 84f2e4a0f8 fix awq and dsv3 fused gemm compatible (#7735) 2025-07-02 22:56:57 -07:00
8e03b641ba [1/n] apply wna16marlin kernel in moe weight only quantization (#7683)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>
2025-07-01 23:21:25 -07:00
AniZpZ 3eb4a800e8 Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842) 2025-06-17 13:45:10 -07:00
d95269f9b3 [2/3] fix dsv3 awq issue (#4625)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
2025-04-03 17:36:39 -07:00