minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

fix: guard configure_deep_gemm_num_sms when JIT disabled (#20868)

Browse Source 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Gabriel Wu
2026-03-18 11:15:20 -07:00
committed by GitHub
co-authored by Claude Opus 4.6
parent a6c7bb54eb
commit 70876ae93b
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/layers/deep_gemm_wrapper/entrypoint.py
+1 -1
View File
@@ -122,7 +122,7 @@ def update_deep_gemm_config(gpu_id: int, server_args: ServerArgs):
@contextmanager @contextmanager
def configure_deep_gemm_num_sms(num_sms): def configure_deep_gemm_num_sms(num_sms):
if num_sms is None: if num_sms is None or not ENABLE_JIT_DEEPGEMM:
yield yield
else: else:
original_num_sms = deep_gemm.get_num_sms() original_num_sms = deep_gemm.get_num_sms()