3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Yubo Wang	20f1c8e374	Fix sampler nan check when calling top_k_top_p_sampling_from_probs (#5546)	2025-04-19 21:47:23 -07:00
Yubo Wang	fd5a55cfd3	Use public model for FA3 speculative decode testing (#5152)	2025-04-08 00:08:25 -07:00
Yubo Wang	804d9f2e4c	Add unit test on page_size > 1 and mla and integration test for Flash Attention 3 (#4760)	2025-04-07 23:20:51 -07:00