|
4f52c9948b
|
keeping router GEMM in fp32 for deterministic inference (DeepSeek V3/V4) (#38176)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-09-15 16:16:09 +08:00 |
|
|
Carrie ChenandBrayden Zhong
|
8ae962021d
|
Use fp32 in TRTLLM all reduce buffers (#36143)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-09-07 16:57:07 +08:00 |
|
|
Carrie ChenandBrayden Zhong
|
6a5a9eccaa
|
add flashinfer cute-dsl backend for mxfp8 gemm (#34042)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-08-13 08:50:01 +08:00 |
|