zijiexiaandClaude Opus 4.8 9da88e32e0 [Cohere2Moe] Enable flashinfer_trtllm NVFP4 fused-MoE via SigmoidRenorm routing (#27401) ...

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-06-05 22:49:20 -07:00

..

attention

Nemotron perf changes (#26733)

2026-06-05 22:31:46 -07:00

deep_gemm_wrapper

Changes for SM120 perf and usability for NVFP4 (#26496)

2026-06-04 15:29:25 -07:00

moe

[Cohere2Moe] Enable flashinfer_trtllm NVFP4 fused-MoE via SigmoidRenorm routing (#27401)

2026-06-05 22:49:20 -07:00

quantization

Nemotron perf changes (#26733)

2026-06-05 22:31:46 -07:00

rotary_embedding

[plugin] default device detection fixes for OOT platform plugins (#25337)

2026-06-06 07:55:50 +08:00

triton_ops

[codex] Centralize Triton utility kernels (#26000)

2026-06-02 16:47:45 +08:00

utils

[Bugfix] Gate DP-attention even-token padding to CP-enabled configs (#26911)

2026-06-03 02:06:52 -04:00

activation.py

Nemotron perf changes (#26733)

2026-06-05 22:31:46 -07:00

amx_utils.py

[CPU] Add GPT-OSS model optimization for CPU (#16775)

2026-05-29 16:05:26 +08:00

clippable_linear.py

[New Model] Gemma 4 (#21952)

2026-04-06 20:24:44 -07:00

communicator_dsa_cp.py

DeepSeek V4: Support context parallelism with fused MoE (non-DeepEP) (#24947)

2026-06-01 14:25:43 -07:00

communicator.py

[parallel] Support moe_dense_tp_size == attn_tp_size to share the attention TP group (#23996)

2026-05-30 02:10:07 -07:00

conv.py

[CPU] Add support for Qwen3-vl and Qwen3-omni (#12662)

2026-05-27 08:56:09 +08:00

deepseek_v4_rope.py

[AMD] Dsv4/pr2 compressor opt (#26208)

2026-05-25 23:54:40 -07:00

dp_attention.py

[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)

2026-05-20 00:18:04 -07:00

elementwise.py

[codex] Centralize Triton utility kernels (#26000)

2026-06-02 16:47:45 +08:00

flashinfer_comm_fusion.py

[Log] include max_token_num and hidden_dim in FlashInfer workspace init log (#26605)

2026-06-01 13:26:52 -07:00

fused_qk_norm_rope_store.py

[AMD] Dsv4/pr1 fix run time issue (#25898)

2026-05-23 16:04:14 -07:00

fused_qk_norm.py

[AMD] Dsv4/pr2 compressor opt (#26208)

2026-05-25 23:54:40 -07:00

gemma4_fused_ops.py

[XPU] Enable Gemma 4 E2B / E4B / 31B/ 26B-A4B on Intel XPU (#23280)

2026-06-05 10:05:07 +08:00

int4fp8_utils.py

[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392)

2026-01-14 01:44:40 -08:00

layernorm.py

[XPU] Enable Gemma 4 E2B / E4B / 31B/ 26B-A4B on Intel XPU (#23280)

2026-06-05 10:05:07 +08:00

linear.py

chore: add vLLM SPDX copyright headers to ported files (#25182)

2026-05-13 15:17:30 -07:00

logits_processor.py

Fix flashinfer autotune oom glm51 (#24195)

2026-06-02 23:28:57 -07:00

mhc_head.py

Optimize MHC pipeline: DeepGemm, fused norm, fused hc_head (#24775)

2026-05-10 19:03:37 +08:00

mhc.py

[DeepSeek-V4] Add mhc_fused_post_pre kernel (#25976)

2026-05-30 02:04:51 -07:00

model_parallel.py

[Refactor] Rename CustomOp -> MultiPlatformOp (#16175)

2025-12-31 01:16:32 +08:00

modelopt_utils.py

Enable native ModelOpt quantization support (1/3) (#7149)

2025-10-06 13:24:15 -07:00

multimodal.py

Fix weights_checker checksum for 0-dim tensors and multi-GPU (#26863)

2026-05-31 21:27:03 -07:00

n_gram_embedding.py

Optimize ngram decode id computation (#24757)

2026-06-02 17:37:34 +08:00

parameter.py

chore: add vLLM SPDX copyright headers to ported files (#25182)

2026-05-13 15:17:30 -07:00

pooler.py

[Score API] Add Multi-Item Scoring with pre-computed delimiter indices (#22544)

2026-04-20 22:50:40 -07:00

radix_attention.py

Allow Optional key/value in unified_attention_with_output split-op (MLA absorb fix) (#26515)

2026-05-28 01:04:07 -07:00

radix_linear_attention.py

[Fix]: BCG support for RadixLinearAttention (Qwen3.5 / linear-attn hybrid models) (#25110)

2026-05-22 13:30:35 -07:00

rocm_linear_utils.py

[AMD] Fix DLPack Error in Aiter flydsl GEMM by Detaching MoE Gate Weight (#22262)

2026-04-07 23:42:10 -07:00

sampler.py

[AMD] Guard aiter greedy_sample OOB token id (fixes VLM MMMU CI) (#27247)

2026-06-04 12:53:58 -07:00

sparse_pooler.py

Implement BGE-M3 Sparse Embeddings in SGLang (#10869)

2025-10-22 13:46:16 -07:00

torchao_utils.py

Lazy import torchao (#17626)

2026-01-22 22:04:51 -08:00

vocab_parallel_embedding.py

[perf] Replicate embed_tokens to drop the post-embed all-reduce (#26970)

2026-06-02 16:48:18 -07:00