Lianmin Zheng e40e339c72 Filter non-int token ids in benchmark and observe decode-side bootstrap/alloc metrics (#24684)

2026-05-08 11:45:37 -07:00

..

datasets

Filter non-int token ids in benchmark and observe decode-side bootstrap/alloc metrics (#24684)

2026-05-08 11:45:37 -07:00

__init__.py

[Refactor] Benchmark Phase 1: extract utils and datasets from bench_serving (#19077)

2026-02-21 13:50:11 -08:00

bench_utils.py

[Benchmark] use flashinfer bench_gpu_time instead of triton do_bench (#20305)

2026-03-12 04:04:30 +00:00

utils.py

[Refactor] Benchmark Phase 1: extract utils and datasets from bench_serving (#19077)

2026-02-21 13:50:11 -08:00