 Yuxuan ZhangandXinyuan Tong
|
00986c81be
|
Support GLM-5.3-Flash hybrid attention CPU offload and PD index mapping (#40310)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-09-21 16:03:03 -07:00 |
|
 
|
f31a7bd45c
|
Use pinned memory for asynchronous sampling metadata transfers (#39777)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-20 15:31:31 -07:00 |
|
 Yuxuan ZhangandXinyuan Tong
|
9f21fbc34b
|
[GLM-5.3-Flash] Reduce KPool planning synchronization and overlap indexer preparation (#39695)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-19 23:51:17 -07:00 |
|
 Yuxuan ZhangandXinyuan Tong
|
c8eb54c41d
|
Fuse GLM-5.3-Flash KDA projections and prefill metadata (#39688)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-19 23:46:33 -07:00 |
|
 
|
929230a6f0
|
Fix GLM-OCR MTP multimodal embeddings and positions (#39088)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-18 21:10:04 -07:00 |
|
 Yuxuan ZhangandXinyuan Tong
|
17ba2c2e7c
|
Support non-strict GLM47 tool calls with EBNF constraints (#38890)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-15 16:41:48 +08:00 |
|
 Yuxuan ZhangandBaizhou Zhang
|
7e229e2a81
|
support GLM-5.2 MTP index sharing with prefill CP (#30992)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-07-13 21:11:27 -07:00 |
|
 
|
78dc581518
|
[bug-fix] Stabilize GLM-5.2 MTP IndexShare across PD and CUDA graph replay (#30839)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 19:37:07 -07:00 |
|
 
|
f79a6b5c33
|
Support GLM-4.7 function calling via structural tags (#28149)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-06-14 14:57:07 +08:00 |
|
Yuxuan Zhang
|
393d0e169e
|
[Bugfix] Restore overridden HF config fields and support index_skip_topk_offset for DSA topk sharing (#27114)
|
2026-06-06 13:26:04 +08:00 |
|