minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Bench] Add MEM profile activity to bench_serving (#25026)

Browse Source 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
Khoa Pham
2026-05-13 16:22:11 -07:00
committed by GitHub
co-authored by Claude Opus 4.7
parent 9a32a0272f
commit 371cb2ade2
1 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/bench_serving.py
+3 -2
View File
@@ -2180,8 +2180,9 @@ if __name__ == "__main__":
type=str, type=str,
nargs="+", nargs="+",
default=["CPU", "GPU"], default=["CPU", "GPU"],
choices=["CPU", "GPU", "CUDA_PROFILER", "XPU"], choices=["CPU", "GPU", "CUDA_PROFILER", "XPU", "MEM"],
help="Profiler activities to capture: CPU, GPU, XPU, CUDA_PROFILER.", help="Profiler activities to capture: CPU, GPU, XPU, CUDA_PROFILER, MEM "
"(MEM dumps a torch.cuda.memory snapshot, viewable at https://pytorch.org/memory_viz).",
) )
parser.add_argument( parser.add_argument(
"--profile-start-step", "--profile-start-step",