[XPU] DeepSeek V4: use sgl-kernel-xpu implemetation of flash_mla_sparse_fwd for prefill (#31865)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
This commit is contained in:
@@ -1780,6 +1780,9 @@ class DeepseekV4AttnBackend(
|
||||
indices. Chunk-invariant scaffolding lives in
|
||||
``self.forward_metadata.sparse_prefill_cache``.
|
||||
"""
|
||||
if _is_xpu:
|
||||
from sgl_kernel import flash_mla_sparse_fwd
|
||||
else:
|
||||
from sgl_kernel.flash_mla import flash_mla_sparse_fwd
|
||||
|
||||
# q is (b, 1, h_q, d_qk); flash_mla_sparse_fwd takes (s_q, h_q, d_qk).
|
||||
|
||||
Reference in New Issue
Block a user