|
4065248214
|
Support Llama4 fp8 inference (#5194)
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-04-09 20:14:34 +08:00 |
|
|
HandH1998
|
2d1b83e57a
|
add dsv3 int8 test (#4705)
|
2025-03-24 21:57:58 -07:00 |
|
|
HandH1998
|
f2ab37e500
|
[Doc] add doc for quantization w8a8_fp8 or w8a8_int8 (#4495)
|
2025-03-17 02:25:00 -07:00 |
|
|
HandH1998
|
2ac189edc8
|
Amd test fp8 (#4261)
|
2025-03-10 10:12:09 -07:00 |
|
|
HandH1998
|
0dd6cda288
|
Apply sgl w8a8 fp8 kernel (#3148)
|
2025-03-09 00:03:32 -08:00 |
|
|
|
c7f254468f
|
[Feature] DeepSeek V3/R1 INT8 Quantization (channel-wise) (#3888)
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: b0urnee <2769086541@qq.com>
|
2025-03-06 20:54:52 -08:00 |
|
|
HandH1998andyych0745
|
82392da830
|
support w8a8 fp8 kernel with CUTLASS (#3047)
Co-authored-by: yych0745 <1398089567@qq.com>
|
2025-01-26 15:46:51 +08:00 |
|
|
HandH1998
|
afa0341e57
|
Update Triton configs for block fp8 kernels (#2641)
|
2024-12-29 22:53:47 +08:00 |
|
|
HandH1998
|
6e5305158c
|
update sgl_moe_align_block_size usage (#2617)
|
2024-12-28 00:01:13 +08:00 |
|
|
HandH1998
|
77d1210b36
|
fix moe_align_block_size (#2615)
|
2024-12-27 23:32:53 +08:00 |
|
|
HandH1998andzhyncs
|
53aed988cb
|
Refactor MoE (#2575)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2024-12-26 00:02:14 +08:00 |
|