3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
5 people	eb6c2c1663	Hybrid kv cache for LLaMA4 (#6563) ... Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com> Co-authored-by: tarinkk <rt572@physics.rutger.edu> Co-authored-by: tarinkk <rt572@rutgers.physics.edu> Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>	2025-06-27 18:58:55 -07:00
tarinkk	9a7e83e899	Fix enable chunked prefill for Llama4 (#5575)	2025-04-20 17:01:30 -07:00
tarinkkandCheng Wan	7f19e083c1	Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) ... Co-authored-by: Cheng Wan <cwan39@gatech.edu>	2025-03-27 17:09:35 -07:00