Commit Graph
7 Commits
Author SHA1 Message Date
c01b2ee094 [PP] Refactor PP to async mode (#11852)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: bluecoffee8 <jasperli2002@gmail.com>
Co-authored-by: zhangxiaolei123456 <zhangxiaolei.666@bytedance.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
2025-12-12 12:54:16 +08:00
Xuchun Shang af35023e65 [bug fix] fix ima with get_mla_kv_buffer_kernel overflow (#14224)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-12-04 01:20:11 -08:00
Xuchun ShangandShangming Cai 80797c2a15 [PD][bug fix] fix memleak when last_batch is none (#13144)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2025-11-17 21:22:20 +08:00
Xuchun Shang ac19ce7efb [PP] put pp assert in model runner (#12934)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-11-10 14:58:19 +08:00
Xuchun Shang e5ec976402 [Bug fix][PP] fix deadlock with tie_word_embeddings (#12362)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-10-30 01:03:28 -07:00
Xuchun Shang a1f2dc90e4 [Bug fix] [PP] fix wrong dtype for quantified model (#12247)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-10-28 01:27:24 -07:00
Xuchun Shang 8154de5a32 [PD] Remove invalid parameter (#4721)
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
2025-03-24 13:14:16 -07:00