3 people 6b94d39f13 [Model Loading] Overlap checkpoint staging with CUDA graph capture during startup (#32017) ...

Co-authored-by: Wenhui Zhu <wzhu59@asu.edu>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>

2026-08-13 12:26:25 -07:00

..

datasets

[misc] Improve benchmark determinism and dataset API coverage (#33255)

2026-08-02 01:39:50 -07:00

__init__.py

[Refactor] Benchmark Phase 1: extract utils and datasets from bench_serving (#19077)

2026-02-21 13:50:11 -08:00

bench_utils.py

[Benchmark] use flashinfer bench_gpu_time instead of triton do_bench (#20305)

2026-03-12 04:04:30 +00:00

dspark_sps_profiler.py

[Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)

2026-07-12 17:25:26 -05:00

dspark_sts_fit.py

[Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)

2026-07-12 17:25:26 -05:00

endpoint.py

[misc] Share bench HTTP-client base-URL resolution with IPv6-compatible formatting (#28598)

2026-06-17 20:50:49 -07:00

offline_throughput.py

[MLX] Fix step-bounded profiling for bench tools on Apple Silicon (#29217)

2026-06-30 22:55:29 -07:00

one_batch_server.py

[misc] Improve benchmark determinism and dataset API coverage (#33255)

2026-08-02 01:39:50 -07:00

one_batch.py

[Model Loading] Overlap checkpoint staging with CUDA graph capture during startup (#32017)

2026-08-13 12:26:25 -07:00

serving.py

Fix serving benchmark post-warmup cache flush race (#33663)

2026-08-06 15:27:10 +00:00

utils.py

[Feature] Add Muse Glimmer model support (#34262)

2026-08-11 15:41:52 -07:00