minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity

[HiCache] Critical fix to host memory double free (#13501)

Browse Source 
Co-authored-by: Hao Chen <cighao@gmail.com>
This commit is contained in:
Zhiqiang Xie
2025-11-18 01:34:23 -08:00
committed by GitHub
co-authored by Hao Chen
parent ac81db66c2
commit cfcf2758aa
1 changed files with 0 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/managers/cache_controller.py
-5
View File
@@ -647,11 +647,6 @@ class HiCacheController:
if prefix_keys and len(prefix_keys) > 0: if prefix_keys and len(prefix_keys) > 0:
prefix_keys += batch_hashes prefix_keys += batch_hashes
# release pre-allocated memory
self.append_host_mem_release(
operation.host_indices[operation.completed_tokens :]
)
def prefetch_io_aux_func(self): def prefetch_io_aux_func(self):
""" """
Auxiliary function conducting IO operations for prefetching. Auxiliary function conducting IO operations for prefetching.