8 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Enrique Shockwave	f11eb90fe4	Initialize model_worker_batch variable (#1973)	2024-11-09 11:28:02 -08:00
Enrique Shockwave	32a4141d5a	Allow new lines during JSON generation (#1277)	2024-09-01 03:42:29 -07:00
Enrique Shockwave	6c34d6339c	make json_schema usable from gen (#1254)	2024-08-28 18:57:10 -07:00
Enrique Shockwave	21e22b9e96	Fix LiteLLM kwargs (#817)	2024-07-29 22:38:02 -07:00
Enrique Shockwave	e2c31fca5c	Include finish reason in meta info response (#415)	2024-05-09 15:14:01 +08:00
Enrique Shockwave	cf9d8efdd3	llama3 instruct template (#372)	2024-04-21 09:40:12 -07:00
Enrique Shockwave	d9b3b01883	enable marlin kernels (#286)	2024-03-12 22:10:12 -04:00
Enrique Shockwave	9759d927cf	fix chatml template (#195)	2024-02-24 16:34:22 +08:00