minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Filter non-int token ids in benchmark and observe decode-side bootstrap/alloc metrics (#24684)

Browse Source
This commit is contained in:
Lianmin Zheng
2026-05-08 11:45:37 -07:00
committed by GitHub
parent 73b8eda103
commit e40e339c72
3 changed files with 18 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
scripts/playground/replay_request_dump.py
+2 -2
View File
@@ -1,10 +1,10 @@
"""
Usage:
# replay from a folder
python3 replay_request_dump.py --file-number 100 --parallel 512 --input-folder /data/lianmin/sglang_request_dump/grok-mini-0220-engine-5756f8f94-28bm6/
python3 replay_request_dump.py --file-number 100 --parallel 512 --input-folder /data/lianmin/sglang_request_dump/engine-34xd1/
# replay from a single file
python3 replay_request_dump.py --parallel 512 --input-file /data/sglang_crash_dump/memx-cti-34-sr1.xpop.twttr.net/crash_dump_2025-06-04_20-13-18.pkl
python3 replay_request_dump.py --parallel 512 --input-file /data/sglang_crash_dump/crash_dump_2025-06-04_20-13-18.pkl
"""
import argparse