 pansicheng
|
48642d5384
|
[RadixTree][4/N Refactor]: Move available_and_evictable_str to individual radix cache classes (#17852)
|
2026-02-19 17:03:15 +08:00 |
|
|
cctry
|
027f314050
|
[Fix] data race in req_to_token pool (#17850)
|
2026-02-02 14:38:15 -08:00 |
|
|
Liangsheng Yin
|
85d077f44d
|
Introduce global alloc_len_per_decode & clean check decode memory (#15115)
|
2026-01-26 10:26:20 -08:00 |
|
|
zhangheng
|
f33022d039
|
[RadixTree][3/N Refactor]：Support unified insert/evict params (#17401)
|
2026-01-22 17:36:31 +08:00 |
|
|
Ke Bao
|
ce8a6ac690
|
Evict swa kv cache during decoding (#17220)
|
2026-01-19 22:36:52 +08:00 |
|
|
Ke Bao
|
7f8a58fffb
|
Refactor prefix cache type checking (#17028)
|
2026-01-15 11:28:13 +08:00 |
|
|
|
fb04e7e3c8
|
[Auto Sync] Update schedule_batch.py, common.py, eagle_info... (20260105) (#16519)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
|
2026-01-08 02:35:46 -08:00 |
|
|
Ke Bao
|
02722b9113
|
Fix evict swa for overlap scheduler and page size > 1 (#16507)
|
2026-01-06 22:29:40 +08:00 |
|
|
Ke Bao
|
76bc07a335
|
Move swa memory pool to a seperate file (#16347)
|
2026-01-04 22:39:30 +08:00 |
|
|
Ke Bao
|
7b7e357f61
|
Separate swa and local attention chunk cache eviction (#15820)
|
2025-12-26 09:34:22 +08:00 |
|
|
Hanming Lu
|
e61dabf5e4
|
[Qwen3-next] support mamba radix cache for overlap scheduler (#14792)
|
2025-12-14 18:54:16 -08:00 |
|
|
Liangsheng Yin
|
665416f6dd
|
Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)
|
2025-11-11 02:56:22 +08:00 |
|
|
jianan-gu
|
899453ac50
|
Use explicit uint64 dtype for Tensor data_ptr() to avoid overflow (#11994)
|
2025-10-27 19:05:57 -07:00 |
|
|
Roger Young
|
dbd9435dc1
|
Fix mamba radix cache eviction logic in alloc_req_slots (#11616)
Signed-off-by: rogeryoungh <rogeryoungh@foxmail.com>
|
2025-10-23 13:07:43 -07:00 |
|
|
Even Zhou
|
3cceaa381a
|
[Bugfix] Fix Qwen3/DSV3/DSV3.2 model support (#11510)
|
2025-10-16 15:14:09 +08:00 |
|
|
Liangsheng Yin
|
516738b096
|
Depreate global_server_args_dict (#11528)
|
2025-10-13 19:34:43 +08:00 |
|
|
Cheng Wan
|
1bdd010291
|
Revert "Deprecate global_server_args_dict" (#11520)
|
2025-10-12 17:40:40 -07:00 |
|
|
Liangsheng Yin
|
1083e7e3df
|
Deprecate global_server_args_dict (#11331)
|
2025-10-13 01:20:47 +08:00 |
|
|
cctry
|
b36afed4a7
|
Separate allocation logic from scheduler (#11313)
|
2025-10-10 17:38:54 -07:00 |
|