Add Support for XVERSE Models (Dense and MoE) to sglang (#1397)

Co-authored-by: will he <hexin@xverse.cn> Co-authored-by: root <root@localhost.localdomain> Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2024-09-12 01:47:52 -07:00
parent 8234e663e9
commit c33d82a211
3 changed files with 830 additions and 0 deletions
@@ -261,6 +261,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct
 - Exaone 3
 - BaiChuan2
 - MiniCPM / MiniCPM 3
+- XVERSE / XVERSE MoE


 **Embedding Models**