Ying Sheng 712216928f [Feature] Initial support for multi-LoRA serving (#1307)

2024-09-12 16:46:14 -07:00

..

controller_multi.py

[Minor] Many cleanup (#1357)

2024-09-09 04:14:11 -07:00

controller_single.py

[Minor] Many cleanup (#1357)

2024-09-09 04:14:11 -07:00

detokenizer_manager.py

[Minor] Improve the function organization in TokenizerManager & improve loggers (#1208)

2024-08-25 14:46:34 -07:00

io_struct.py

[Feature] Initial support for multi-LoRA serving (#1307)

2024-09-12 16:46:14 -07:00

policy_scheduler.py

Fix some online scheduling delay (#1345)

2024-09-07 20:46:27 -07:00

schedule_batch.py

[Feature] Initial support for multi-LoRA serving (#1307)

2024-09-12 16:46:14 -07:00

tokenizer_manager.py

[Feature] Initial support for multi-LoRA serving (#1307)

2024-09-12 16:46:14 -07:00

tp_worker.py

[Feature] Initial support for multi-LoRA serving (#1307)

2024-09-12 16:46:14 -07:00