Clintandclintg6 cfb7fb4fad [AMD] Fix TP2 DeepSeek-R1 nhead=64 MLA decode crash and add nightly coverage (#27188) ...

Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>

2026-06-03 16:56:05 -07:00

..

attention

[AMD] Fix TP2 DeepSeek-R1 nhead=64 MLA decode crash and add nightly coverage (#27188)

2026-06-03 16:56:05 -07:00

deep_gemm_wrapper

[MoE] Support BF16 standard A2A with DeepGEMM runner (#26473)

2026-06-01 20:40:38 -07:00

moe

fix(moe): avoid unpacking None from masked deep_gemm without overlap when sbo enabled (#26839)

2026-06-03 00:44:28 -07:00

quantization

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005)

2026-06-03 12:55:24 -07:00

rotary_embedding

Add fused_rope and for xpu (#25773)

2026-06-03 09:41:42 +08:00

triton_ops

[codex] Centralize Triton utility kernels (#26000)

2026-06-02 16:47:45 +08:00

utils

[Bugfix] Gate DP-attention even-token padding to CP-enabled configs (#26911)

2026-06-03 02:06:52 -04:00

activation.py

[AMD] Dsv4/pr2 compressor opt (#26208)

2026-05-25 23:54:40 -07:00

amx_utils.py

[CPU] Add GPT-OSS model optimization for CPU (#16775)

2026-05-29 16:05:26 +08:00

clippable_linear.py

[New Model] Gemma 4 (#21952)

2026-04-06 20:24:44 -07:00

communicator_dsa_cp.py

DeepSeek V4: Support context parallelism with fused MoE (non-DeepEP) (#24947)

2026-06-01 14:25:43 -07:00

communicator.py

[parallel] Support moe_dense_tp_size == attn_tp_size to share the attention TP group (#23996)

2026-05-30 02:10:07 -07:00

conv.py

[CPU] Add support for Qwen3-vl and Qwen3-omni (#12662)

2026-05-27 08:56:09 +08:00

deepseek_v4_rope.py

[AMD] Dsv4/pr2 compressor opt (#26208)

2026-05-25 23:54:40 -07:00

dp_attention.py

[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)

2026-05-20 00:18:04 -07:00

elementwise.py

[codex] Centralize Triton utility kernels (#26000)

2026-06-02 16:47:45 +08:00

flashinfer_comm_fusion.py

[Log] include max_token_num and hidden_dim in FlashInfer workspace init log (#26605)

2026-06-01 13:26:52 -07:00

fused_qk_norm_rope_store.py

[AMD] Dsv4/pr1 fix run time issue (#25898)

2026-05-23 16:04:14 -07:00

fused_qk_norm.py

[AMD] Dsv4/pr2 compressor opt (#26208)

2026-05-25 23:54:40 -07:00

gemma4_fused_ops.py

perf(gemma4): single-launch fused router (topk + softmax + scale) (#26502)

2026-06-02 16:00:17 +08:00

int4fp8_utils.py

[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392)

2026-01-14 01:44:40 -08:00

layernorm.py

Fix GemmaRMSNorm gemma_weight buffer storage for Qwen3.5 (#26430)

2026-05-28 18:42:46 +08:00

linear.py

chore: add vLLM SPDX copyright headers to ported files (#25182)

2026-05-13 15:17:30 -07:00

logits_processor.py

Fix flashinfer autotune oom glm51 (#24195)

2026-06-02 23:28:57 -07:00

mhc_head.py

Optimize MHC pipeline: DeepGemm, fused norm, fused hc_head (#24775)

2026-05-10 19:03:37 +08:00

mhc.py

[DeepSeek-V4] Add mhc_fused_post_pre kernel (#25976)

2026-05-30 02:04:51 -07:00

model_parallel.py

[Refactor] Rename CustomOp -> MultiPlatformOp (#16175)

2025-12-31 01:16:32 +08:00

modelopt_utils.py

Enable native ModelOpt quantization support (1/3) (#7149)

2025-10-06 13:24:15 -07:00

multimodal.py

Fix weights_checker checksum for 0-dim tensors and multi-GPU (#26863)

2026-05-31 21:27:03 -07:00

n_gram_embedding.py

Optimize ngram decode id computation (#24757)

2026-06-02 17:37:34 +08:00

parameter.py

chore: add vLLM SPDX copyright headers to ported files (#25182)

2026-05-13 15:17:30 -07:00

pooler.py

[Score API] Add Multi-Item Scoring with pre-computed delimiter indices (#22544)

2026-04-20 22:50:40 -07:00

radix_attention.py

Allow Optional key/value in unified_attention_with_output split-op (MLA absorb fix) (#26515)

2026-05-28 01:04:07 -07:00

radix_linear_attention.py

[Fix]: BCG support for RadixLinearAttention (Qwen3.5 / linear-attn hybrid models) (#25110)

2026-05-22 13:30:35 -07:00

rocm_linear_utils.py

[AMD] Fix DLPack Error in Aiter flydsl GEMM by Detaching MoE Gate Weight (#22262)

2026-04-07 23:42:10 -07:00

sampler.py

[AMD][DSV4] DSV4 MTP graph + sparse triton attn optimizations (#26383)

2026-05-27 15:23:35 -07:00

sparse_pooler.py

Implement BGE-M3 Sparse Embeddings in SGLang (#10869)

2025-10-22 13:46:16 -07:00

torchao_utils.py

Lazy import torchao (#17626)

2026-01-22 22:04:51 -08:00

vocab_parallel_embedding.py

[perf] Replicate embed_tokens to drop the post-embed all-reduce (#26970)

2026-06-02 16:48:18 -07:00