Online serving benchmarks of real datasets for hierarchical KV caching (#3211)

Browse Source

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

...

This commit is contained in:

Yueyang Pan

2025-03-05 16:16:43 -08:00

committed by GitHub

co-authored by Zhiqiang Xie

parent 62b362b1f1

commit 25482edb5c

6 changed files with 1914 additions and 1 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

benchmark/hicache/bench_serving.py

+1029

File diff suppressed because it is too large Load Diff