minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Model: Support IBM Granite (Dense/Mamba + MoE) (#18040)

Browse Source
This commit is contained in:
Bhavneek Singh
2026-02-15 11:24:41 +08:00
committed by GitHub
parent 4cf4f0859f
commit 1ce3420784
8 changed files with 1072 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/supported_models/text_generation/generative_models.md
+1
View File
@@ -68,3 +68,4 @@ in the GitHub search bar.
| **Trinity** (Nano, Mini) | `arcee-ai/Trinity-Mini` | Arcee's foundational MoE Trinity family of models, open weights under Apache 2.0. |
| **Falcon-H1** (0.5B–34B) | `tiiuae/Falcon-H1-34B-Instruct` | TII's hybrid Mamba-Transformer architecture combining attention and state-space models for efficient long-context inference. |
| **Hunyuan-Large** (389B, MoE) | `tencent/Tencent-Hunyuan-Large` | Tencent's open-source MoE model with 389B total / 52B active parameters, featuring Cross-Layer Attention (CLA) for improved efficiency. |
| **IBM Granite 4.0 (Hybrid, Dense)** | `ibm-granite/granite-4.0-h-micro`, `ibm-granite/granite-4.0-micro` | IBM Granite 4.0 micro models: hybrid Mamba–MoE (`h-micro`) and dense (`micro`) variants. Enterprise-focused reasoning models |