4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
YAMY	c8492978a1	Fix Illegal Instruction/IMA errors when using DP attention -- num_tokens_for_logprob calculation (#12115)	2025-10-25 12:28:26 -07:00
YAMY	80407b0493	Fix: Dynamic RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds in EAGLE + Long-Sequence Workloads (#10788)	2025-10-19 11:37:43 +08:00
YAMYandXinyuan Tong	5a9170d993	Optimize copy_kv_cache for spec decoding (#11126) ... Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>	2025-10-08 10:43:30 +08:00
4 people	b045841bae	Feature/function calling update (#2700) ... Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu> Co-authored-by: Chayenne <zhaochen20@outlook.com> Co-authored-by: shuaills <shishuaiuoe@gmail.com>	2025-01-26 09:57:51 -08:00