|
c2c3629f2d
|
[Kimi-K3] O(1) expert weight lookup in load_weights (#38805)
Signed-off-by: JinYan Su <751080330@qq.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-20 14:39:45 -07:00 |
|
|
JinYan SuandZhiqiang Xie
|
72e2f70ef7
|
feat(hicache): support numa detect to reduce long tail latency (#11028)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-01-15 14:11:49 -08:00 |
|
|
JinYan Su
|
22fe5da13e
|
Fix negative duration panic in token bucket wait time calculation (#14941)
Signed-off-by: xiaguan <751080330@qq.com>
|
2025-12-11 21:16:47 -08:00 |
|
|
JinYan Suandhuangtingwei
|
9aa4502d11
|
feat(mooncake): support GB suffix for global_segment_size (#10745)
Signed-off-by: Jinyang Su <751080330@qq.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
|
2025-10-10 17:38:25 -07:00 |
|
|
JinYan Su
|
6c0bb32711
|
fix(decode): adjust ServerArgs import to explicit module path (#11007)
|
2025-10-08 01:27:50 -07:00 |
|
|
JinYan SuandZhiqiang Xie
|
37565b7f21
|
fix(cache): move ongoing_prefetch pop after validation to prevent leak (#9927)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-03 02:39:34 +00:00 |
|