Commit Graph
7 Commits
Author SHA1 Message Date
Lzhang-hub d42975c641 Remove duplicate code in qwen2 model (#10540) 2025-09-24 02:40:51 +08:00
Lzhang-hub 4efe2c57c9 support vlm model spec bench (#10173) 2025-09-10 13:37:04 +08:00
Lzhang-hub 37d83c6e6d Qwen2.5-VL eagle3 infer (#8801) 2025-09-07 20:44:34 -07:00
Lzhang-hub 3a3918121f fix bench serving bug (#4135) 2025-03-06 05:34:02 -08:00
Lzhang-hub 6ec75e626d add qwen2 eagle model (#2863) 2025-01-13 05:29:33 -08:00
Lzhang-hubandYineng Zhang 76d14f8cb9 add 2*h20 node serving example for deepseek v3 (#2650)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2024-12-30 13:04:38 +08:00
a146d9990e support prometheus metrics (#1853)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2024-11-05 20:42:53 -08:00