 Glen Liu
|
cbf23dbbfa
|
[Feature] add --lora-request-distribution arg to bench_serving.py and support skewed and distinct workloads (#12175)
|
2025-11-04 21:41:40 -08:00 |
|
|
Glen Liu
|
fc86b18b3e
|
adjust dynamic vs static outputs comparison in test_lora_update.py (#11884)
|
2025-10-24 10:35:34 -07:00 |
|
|
Glen Liu
|
47c606d3dc
|
[Feature] support regex strings as a stopping condition (#10635)
|
2025-10-12 10:53:15 +08:00 |
|
|
Glen Liu
|
9a7e7a6576
|
[Bug Fix] prevent lora adapter from being loaded into LoRAManager if it is already loaded (#11365)
|
2025-10-09 18:43:03 -07:00 |
|
|
Glen Liu
|
ebd0e1c18b
|
[doc] add walkthrough for implementing and hosting a simple llama wrapper m… (#10093)
|
2025-09-10 12:05:06 +08:00 |
|