[plugin] enable OOT platforms to provide custom quant configs (#25347)
Signed-off-by: Devashish Lal <devcode@fb.com> Co-authored-by: Devashish Lal <devcode@fb.com> Co-authored-by: Devashish Lal <laldevashish@gmail.com>
This commit is contained in:
co-authored by
Devashish Lal
Devashish Lal
parent
857ecb2dbc
commit
52a5c01eba
@@ -521,6 +521,11 @@ python -c "from sglang.srt.platforms import current_platform; print(current_plat
|
||||
<td><code>raise NotImplementedError</code></td>
|
||||
<td>Paged allocator class</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td><code>get_quantization_config(quantization)</code></td>
|
||||
<td><code>raise NotImplementedError</code></td>
|
||||
<td>Return hardware-specific quantization config for the specific quantization scheme, raise an error if not supported or return None to use the default config.</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td><code>get_piecewise_backend_cls()</code></td>
|
||||
<td><code>raise NotImplementedError</code></td>
|
||||
|
||||
Reference in New Issue
Block a user