minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Ascend] add npu synchronize (#13154)

Browse Source 
Co-authored-by: may_feimei <meifei5@huawei.com>
This commit is contained in:
Mayyyy
2025-11-13 11:03:32 +08:00
committed by GitHub
co-authored by may_feimei
parent 909d0d382f
commit 7a8524b444
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/managers/scheduler_update_weights_mixin.py
+1 -1
View File
@@ -132,7 +132,7 @@ class SchedulerUpdateWeightsMixin:
if GPU_MEMORY_TYPE_CUDA_GRAPH in tags: if GPU_MEMORY_TYPE_CUDA_GRAPH in tags:
self.memory_saver_adapter.pause(GPU_MEMORY_TYPE_CUDA_GRAPH) self.memory_saver_adapter.pause(GPU_MEMORY_TYPE_CUDA_GRAPH)
torch.cuda.synchronize() torch.get_device_module().synchronize()
return ReleaseMemoryOccupationReqOutput() return ReleaseMemoryOccupationReqOutput()