Commit Graph
13 Commits
Author SHA1 Message Date
Ziang Li 78cb38ed5e [FlashInfer v0.6.11] [RL] Support FlashInfer per-token NVFP4 MoE (#22918) 2026-05-19 01:04:48 -07:00
Ziang LiandBrayden Zhong 1758856762 [CI] Fix mxfp8 TrtllmGenMoe test (#23125)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-04-24 09:02:11 +00:00
Ziang Li 5593539942 [RL] Refactor NVFP4 shuffling/swizzling to in-place replacement (#22204) 2026-04-12 19:08:45 -07:00
Ziang Li 31453bb76a [RL] Fix weight update for mxfp8 flashinfer_cutlass gemm backend (#22484) 2026-04-12 13:02:17 +00:00
Ziang Li 78043d4448 [Misc] [MXFP8] Drop sm100 mxfp8 warning (#21881) 2026-04-11 11:11:28 +00:00
Ziang Li 990c7590b8 [RL] Support mxfp8 DeepSeek V3 (#21280) 2026-04-03 21:57:45 -07:00
Ziang Li a19ef3a615 [FlashInver v0.6.7] Integrate flashinfer_trtllm mxfp8 gemm (#21576) 2026-04-01 15:55:06 -04:00
Ziang Li 1a4b383fac [CI] [FlashInfer v0.6.7] Use offline quantized checkpoint for MXFP8 Gemm tests (#21625) 2026-03-29 22:47:46 -07:00
Ziang Li ce0541404f [FlashInfer v0.6.6][RL] Support fp8-last-n-bf16 RL for flashinfer_trtllm_routed moe backend (#20214) 2026-03-22 11:17:01 -07:00
Ziang Li 76ee4bb98c [FlashInfer v0.6.4] [RL] Integrate FlashInfer mxfp8 gemm, MoE, and routed MoE (#19537) 2026-03-10 15:37:57 -07:00
Ziang Li 0e86977811 [RL] Support per-layer mixed FP8/BF16 serving for FP8 checkpoints (#18742) 2026-03-01 21:59:22 +08:00
Ziang Li 9469ad089b Fix nvfp4 weight update (#18085) 2026-02-27 14:55:08 -08:00
Ziang Li eddf193292 [DSv32] [GLM5] Improve Model Quality by Avoiding FP32 Precision Loss in weights_proj (#19041) 2026-02-22 16:20:51 +08:00