minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Adjust KL_THRESHOLD for log probability calculations (#30101)

Browse Source
This commit is contained in:
Cheng Wan
2026-07-03 23:53:51 -07:00
committed by GitHub
parent ad744c6c6b
commit 88db9e033a
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
test/registered/lora/test_lora_qwen3_30b_a3b_instruct_2507_logprob_diff.py
+1 -1
View File
@@ -46,7 +46,7 @@ EXPERTS_SHARED_OUTER_LORAS = True
PREFILL_ATTENTION_BACKEND = "fa4"
DECODE_ATTENTION_BACKEND = "fa4"
KL_THRESHOLD = 5e-3
KL_THRESHOLD = 6e-3 # it was 5e-3 with KL 4.766e-3. KL now is 5.008e-3.
def kl_v2(a, b):