 siyu
|
e7e7894016
|
[Weight Cache] Make daemon socket/ready paths configurable via env (#36299)
|
2026-08-26 12:38:50 -07:00 |
|
|
siyuandliusy58
|
cb10ca16dd
|
[FEAT] Weight Daemon abstraction (#33279)
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
|
2026-08-22 02:13:46 -07:00 |
|
|
|
8a123cbd0e
|
[Refactor] New EPD (#30398)
Co-authored-by: Yuang Chen <1131578721@qq.com>
Co-authored-by: Yuang Chen <cya539102@antgroup.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
|
2026-08-21 15:22:48 +08:00 |
|
|
siyuandliusy58
|
58e327480a
|
update codeowner (#34802)
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
|
2026-08-19 22:43:15 -07:00 |
|
|
|
14ffd447a4
|
[FEAT] Decouple multimodal global cache from Mooncake (#30392)
Co-authored-by: Yuang Chen <cya539102@antgroup.com>
Co-authored-by: Yuang Chen <1131578721@qq.com>
|
2026-08-10 19:23:19 +08:00 |
|
|
siyu
|
d27d8b24de
|
fix (#28597)
|
2026-06-17 20:03:23 -07:00 |
|
|
siyu
|
13dda3b8de
|
[EPD] Support dynamic encoder register (#22253)
|
2026-06-08 16:05:16 +08:00 |
|
|
siyu
|
06836aa38a
|
update code owner (#26060)
|
2026-05-22 16:13:28 +08:00 |
|
|
siyu
|
c6184b7dc0
|
Fix EPD OOM by offloading precomputed_embeddings during chunked prefill (#16503)
|
2026-03-08 20:10:40 -07:00 |
|
|
siyu
|
c0fdfd4b92
|
Delete mm.feature after decode phase (#17324)
|
2026-02-24 18:13:03 -08:00 |
|
|
|
245430eaac
|
Encoder Global Cache Manager (#16137)
Co-authored-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2026-02-24 18:05:43 -08:00 |
|
|
siyu
|
0b15f19927
|
[EPD] Add notification mechanism to fix server hang and add timeout env var (#18229)
|
2026-02-10 11:52:54 +08:00 |
|
|
siyu
|
f1824a957b
|
[EPD][refactor]: introduce BaseMMReceiver for gRPC transport integration (#17921)
|
2026-02-02 11:37:32 +08:00 |
|
|
siyuandYuhao Yang
|
4d00bd17a3
|
use shared memory for multimodal feature transport between Tokenizer and Scheduler (#16402)
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-01-27 11:01:08 -08:00 |
|
|
siyu
|
17349168bb
|
set cooldown_interval_minutes to 0 for liusy58 (#17637)
|
2026-01-22 23:36:05 -08:00 |
|
|
siyu
|
62e6a749b0
|
Skip mm feature pool init to avoid EPD OOM (#16388)
|
2026-01-23 10:53:45 +08:00 |
|
|
siyuandZhengWG
|
7520b92927
|
Support EPD error handling (#16670)
Co-authored-by: ZhengWG <zwg0606@gmail.com>
|
2026-01-21 18:47:00 +08:00 |
|
|
siyu
|
e18e0057a4
|
Add an env var to allow transferring small metadata via TCP for PD (#16951)
|
2026-01-16 18:32:22 -08:00 |
|
|
siyu
|
068abe7e40
|
add doc for #14386 (#14655)
|
2026-01-09 22:38:51 +08:00 |
|
|
siyu
|
6b3f93c4dd
|
vlm: support SGLANG_MM_SKIP_COMPUTE_HASH for bypassing multimodal feature hashing (#16555)
|
2026-01-08 11:10:00 +08:00 |
|
|
|
fba785c459
|
use aync load for encoder_server (#15456)
Signed-off-by: liuanqi <liuanqi6@xiaomi.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: liuanqi <liuanqi6@xiaomi.com>
|
2026-01-06 14:31:52 +08:00 |
|
|
|
078d96213a
|
[FEAT] optimize tensor zmq transfer for multimodal inputs (#13592)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-01-03 12:23:23 +08:00 |
|
|
siyu
|
abdf65d4f3
|
Fix OOM by offloading multimodal features to CPU after embedding (#16018)
|
2025-12-31 23:02:34 +08:00 |
|