 Teng Ma
|
b8ac4fcb51
|
[PD] feat: refactor custom mem pool and add barex pd support (#12332)
|
2025-11-09 18:51:34 +08:00 |
|
|
Teng Ma
|
78c58621d2
|
[mem pool] bugfix: wrong position for self.device in Mamba (#12684)
|
2025-11-07 03:05:42 +08:00 |
|
|
Teng Ma
|
1689c0e35f
|
[Doc] fix miss index for production request trace (#12547)
|
2025-11-03 17:57:09 -08:00 |
|
|
Teng Ma
|
32438eba45
|
[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)
|
2025-10-30 10:39:27 +08:00 |
|
|
|
96a5e4dd79
|
[Feature] Support loading weights from ckpt engine worker (#11755)
Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Co-authored-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-23 09:23:30 -07:00 |
|
|
Teng Ma
|
585e1223f0
|
[HiCache] feat: add more eviction policy (#11506)
|
2025-10-18 15:49:45 +00:00 |
|
|
Teng Ma
|
9082a7d323
|
[HiCache] feat: add multi tenant with prefix tag (#9256)
|
2025-10-11 00:23:28 +08:00 |
|
|
Teng Ma
|
9816989bff
|
[HiCache] bug: fix mooncake store batch set v1 (#11013)
|
2025-09-28 23:18:48 +08:00 |
|
|
|
77098aea7b
|
[HiCache] Add tests for hicache storage mooncake backend (#10171)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-18 01:07:16 +08:00 |
|
|
Teng Ma
|
49f169d53e
|
[HiCache] doc: update deployment in readme (#10332)
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-09-12 16:35:37 -07:00 |
|
|
Teng Ma
|
7fce2fd91a
|
[HiCache] fix mooncake config in different tp size (#10377)
|
2025-09-12 16:34:23 -07:00 |
|
|
Teng Ma
|
8471e5e616
|
[HiCache] feat: add mooncake backend extra config (#10213)
|
2025-09-09 12:50:00 -07:00 |
|
|
Teng MaandXuchun Shang
|
a02071a12c
|
[Bench] feat: mooncake trace integration (#9839)
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
|
2025-09-09 02:50:54 +08:00 |
|
|
Teng Maandhzh0425
|
f05c68733e
|
[HiCache] Clear kvcache in storage backend with fastAPI (#9750)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2025-08-31 17:41:44 +08:00 |
|
|
Teng MaandShangming Cai
|
4a16a71c36
|
[PD] feat: mooncake use batch reg/dereg (#8910)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-13 09:54:34 -07:00 |
|