[Intel GPU] DeepSeek V4 5/N: Use sgl-kernel implementation of fused_q_indexer_rope_hadamard_quant to run on XPU (#27873)
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
This commit is contained in:
@@ -171,6 +171,18 @@ def fused_q_indexer_rope_hadamard_quant(
|
|||||||
freqs_real,
|
freqs_real,
|
||||||
positions,
|
positions,
|
||||||
)
|
)
|
||||||
|
elif _is_xpu:
|
||||||
|
from sgl_kernel import fused_q_indexer_rope_hadamard_quant
|
||||||
|
|
||||||
|
fused_q_indexer_rope_hadamard_quant(
|
||||||
|
q_input,
|
||||||
|
q_fp8,
|
||||||
|
weight,
|
||||||
|
weights_out,
|
||||||
|
float(weight_scale),
|
||||||
|
freqs_real,
|
||||||
|
positions,
|
||||||
|
)
|
||||||
else:
|
else:
|
||||||
module = _jit_main_q_indexer_rope_hadamard_quant_module(q_input.dtype)
|
module = _jit_main_q_indexer_rope_hadamard_quant_module(q_input.dtype)
|
||||||
module.forward(
|
module.forward(
|
||||||
|
|||||||
Reference in New Issue
Block a user