3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Lzhang-hub	6ec75e626d	add qwen2 eagle model (#2863)	2025-01-13 05:29:33 -08:00
Lzhang-hubandYineng Zhang	76d14f8cb9	add 2*h20 node serving example for deepseek v3 (#2650) ... Co-authored-by: Yineng Zhang <me@zhyncs.com>	2024-12-30 13:04:38 +08:00
3 people	a146d9990e	support prometheus metrics (#1853) ... Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com> Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>	2024-11-05 20:42:53 -08:00