 Glen Liu
|
ad1b4e4728
|
[Feature] overlap LoRA weight loading with compute (#15512)
|
2026-01-19 10:43:17 +08:00 |
|
|
Glen Liu
|
6b065298b5
|
[Docs] add routing-key to schedule-policy in docs (#17101)
|
2026-01-14 22:22:07 -05:00 |
|
|
Glen Liu
|
6327dff242
|
enhance LoRA tests and fix base model LoRA eviction in Scheduler (#16333)
|
2026-01-10 16:49:00 +08:00 |
|
|
Glen Liu
|
eb1d885400
|
add LoRA warning if loading a preexisting LoRA adapter with a different name (#13822)
|
2025-11-24 15:16:41 -08:00 |
|
|
Glen Liu
|
53620a1b1a
|
fix test_lora_update.py starvation message check (#13702)
|
2025-11-21 19:33:04 -08:00 |
|
|
Glen Liu
|
750084ae08
|
remove unnecessary starvation check (#13619)
|
2025-11-20 19:10:51 -08:00 |
|
|
Glen Liu
|
ada8ce1fd0
|
allow loras to be implicitly evicted and loaded based on max_loaded_loras (#11526)
|
2025-11-20 13:34:32 -08:00 |
|
|
Glen Liu
|
d79e12941c
|
Small cleanups related to LoRA weight loading (#13474)
|
2025-11-18 09:14:34 -08:00 |
|
|
Glen Liu
|
cbf23dbbfa
|
[Feature] add --lora-request-distribution arg to bench_serving.py and support skewed and distinct workloads (#12175)
|
2025-11-04 21:41:40 -08:00 |
|
|
Glen Liu
|
fc86b18b3e
|
adjust dynamic vs static outputs comparison in test_lora_update.py (#11884)
|
2025-10-24 10:35:34 -07:00 |
|
|
Glen Liu
|
47c606d3dc
|
[Feature] support regex strings as a stopping condition (#10635)
|
2025-10-12 10:53:15 +08:00 |
|
|
Glen Liu
|
9a7e7a6576
|
[Bug Fix] prevent lora adapter from being loaded into LoRAManager if it is already loaded (#11365)
|
2025-10-09 18:43:03 -07:00 |
|
|
Glen Liu
|
ebd0e1c18b
|
[doc] add walkthrough for implementing and hosting a simple llama wrapper m… (#10093)
|
2025-09-10 12:05:06 +08:00 |
|