minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Simulator] Add high-fidelity CPU-based inference simulator (#33824)

Browse Source 
Co-authored-by: zhouhaizhu.zhz <zhouhaizhu.zhz@alibaba-inc.com>
Co-authored-by: LinSiyuan814 <linsiyuan.lsy@alibaba-inc.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
This commit is contained in:
Ruiyan Ma
2026-09-04 11:12:11 +08:00
committed by GitHub
co-authored by zhouhaizhu.zhz LinSiyuan814 hzh0425
parent a5f07b1241
commit 59799a3687
81 changed files with 6624 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tools/sglang-simulator/examples/workloads/timestamp-trace-example.jsonl
+3
View File
@@ -0,0 +1,3 @@
{"prompt":[100,101,102,103],"prompt_len":4,"output_len":4,"timestamp":0}
{"prompt":[100,101,102,104],"prompt_len":4,"output_len":4,"timestamp":75}
{"prompt":[200,201,202,203],"prompt_len":4,"output_len":4,"timestamp":250}