[plugin] enable OOT platforms to provide custom quant configs (#25347)

Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <laldevashish@gmail.com>
This commit is contained in:
DevashishLal-CB
2026-06-07 12:48:55 +08:00
committed by GitHub
co-authored by Devashish Lal Devashish Lal
parent 857ecb2dbc
commit 52a5c01eba
3 changed files with 28 additions and 0 deletions
@@ -521,6 +521,11 @@ python -c "from sglang.srt.platforms import current_platform; print(current_plat
<td><code>raise NotImplementedError</code></td>
<td>Paged allocator class</td>
</tr>
<tr>
<td><code>get_quantization_config(quantization)</code></td>
<td><code>raise NotImplementedError</code></td>
<td>Return hardware-specific quantization config for the specific quantization scheme, raise an error if not supported or return None to use the default config.</td>
</tr>
<tr>
<td><code>get_piecewise_backend_cls()</code></td>
<td><code>raise NotImplementedError</code></td>