 Teng MaandTeng Ma
|
15b256bdb0
|
[HiCache] fix: resolve Mooncake local_hostname per node for runtime attach (#29668)
Co-authored-by: Teng Ma <11641725+stmatengss@users.noreply.github.com>
|
2026-09-17 15:51:21 +08:00 |
|
|
Teng Ma
|
175336ff73
|
[Chore] update codeowner for mooncake store (#28377)
|
2026-06-16 14:51:34 +08:00 |
|
|
Teng MaandZijie Xia
|
b562da0d9f
|
[PD] docs: clarify disaggregation IB device formats (#25521)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-06-02 11:38:33 +08:00 |
|
|
Teng Ma
|
544f3039d5
|
[PD] Fix IB device validation for JSON mappings (#26114)
|
2026-05-29 16:44:49 +08:00 |
|
|
|
d45ee3f6c5
|
[HiCache] fix: Mooncake Dummy Client mode for hybrid Mamba models (#25278)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Teng Ma <stmatengss@users.noreply.github.com>
|
2026-05-27 10:29:52 +08:00 |
|
|
|
be156d6804
|
[HiCache] enable ssd offload support for mooncake store (#24277)
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: stmatengss <11641725+stmatengss@users.noreply.github.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-05-13 23:07:02 -07:00 |
|
|
Teng MaandShangming Cai
|
97fc950635
|
[Docker] chore: update mooncake wheel version (#20731)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-04-22 13:36:10 -07:00 |
|
|
Teng Ma
|
7c498a6538
|
[DOC] add documents for encoder global mm cache (#20636)
|
2026-03-15 16:44:21 -07:00 |
|
|
Teng Ma
|
df733c5ee5
|
[HiCache][PP] add test case for compatibility (#16395)
|
2026-02-09 18:03:04 -08:00 |
|
|
Teng MaandShangming Cai
|
c8212b9fac
|
[PD] doc: Document SGLANG_MOONCAKE_CUSTOM_MEM_POOL and supported values (#18259)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-02-05 03:03:33 +00:00 |
|
|
Teng Ma
|
d566739b65
|
Add sufeng-buaa into CI_PERMISSION (#16625)
Signed-off-by: Teng Ma <teng-ma@linux.alibaba.com>
|
2026-01-08 11:01:32 +08:00 |
|
|
|
bdde949619
|
[HiCache] Add PP Support with suffix pp rank (#15175)
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-01-03 13:49:21 +08:00 |
|
|
Teng MaandXuchun Shang
|
d7301c89ba
|
[Feature] support fastsafetensors (#15091)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-23 22:33:56 +08:00 |
|
|
Teng MaandShangming Cai
|
f5f3a5d98c
|
[PD] Support json file configuration for Transfer Engine (#14059)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-01 10:47:33 +08:00 |
|
|
Teng Ma
|
1bb063aac8
|
[HiCache] fix unit test with changed new APIs (#13498)
|
2025-11-21 15:40:31 +08:00 |
|
|
Teng Ma
|
290fcd8971
|
[HiCache] add GPU id to IB dev topo for mooncake storage backend (#13112)
|
2025-11-17 15:48:29 +08:00 |
|
|
Teng MaandShangming Cai
|
44e391b6e9
|
[PD] Add custom gpu id to device topo support (#12817)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-11-12 15:00:45 +08:00 |
|
|
Teng Ma
|
b8ac4fcb51
|
[PD] feat: refactor custom mem pool and add barex pd support (#12332)
|
2025-11-09 18:51:34 +08:00 |
|
|
Teng Ma
|
78c58621d2
|
[mem pool] bugfix: wrong position for self.device in Mamba (#12684)
|
2025-11-07 03:05:42 +08:00 |
|
|
Teng Ma
|
1689c0e35f
|
[Doc] fix miss index for production request trace (#12547)
|
2025-11-03 17:57:09 -08:00 |
|
|
Teng Ma
|
32438eba45
|
[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)
|
2025-10-30 10:39:27 +08:00 |
|
|
|
96a5e4dd79
|
[Feature] Support loading weights from ckpt engine worker (#11755)
Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Co-authored-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-23 09:23:30 -07:00 |
|
|
Teng Ma
|
585e1223f0
|
[HiCache] feat: add more eviction policy (#11506)
|
2025-10-18 15:49:45 +00:00 |
|
|
Teng Ma
|
9082a7d323
|
[HiCache] feat: add multi tenant with prefix tag (#9256)
|
2025-10-11 00:23:28 +08:00 |
|
|
Teng Ma
|
9816989bff
|
[HiCache] bug: fix mooncake store batch set v1 (#11013)
|
2025-09-28 23:18:48 +08:00 |
|
|
|
77098aea7b
|
[HiCache] Add tests for hicache storage mooncake backend (#10171)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-18 01:07:16 +08:00 |
|
|
Teng Ma
|
49f169d53e
|
[HiCache] doc: update deployment in readme (#10332)
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-09-12 16:35:37 -07:00 |
|
|
Teng Ma
|
7fce2fd91a
|
[HiCache] fix mooncake config in different tp size (#10377)
|
2025-09-12 16:34:23 -07:00 |
|
|
Teng Ma
|
8471e5e616
|
[HiCache] feat: add mooncake backend extra config (#10213)
|
2025-09-09 12:50:00 -07:00 |
|
|
Teng MaandXuchun Shang
|
a02071a12c
|
[Bench] feat: mooncake trace integration (#9839)
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
|
2025-09-09 02:50:54 +08:00 |
|
|
Teng Maandhzh0425
|
f05c68733e
|
[HiCache] Clear kvcache in storage backend with fastAPI (#9750)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2025-08-31 17:41:44 +08:00 |
|
|
Teng MaandShangming Cai
|
4a16a71c36
|
[PD] feat: mooncake use batch reg/dereg (#8910)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-13 09:54:34 -07:00 |
|