sglang

attention

[Refactor] Generalize attention graph variants in the decode runner (#38993 )

2026-09-11 00:45:58 -07:00

cp

[CP V1 Deprecation 4/5] Canonicalize prefill CP API names (#36229 )

2026-09-08 16:03:36 -07:00

dcp

[CP V1 Deprecation 4/5] Canonicalize prefill CP API names (#36229 )

2026-09-08 16:03:36 -07:00

deep_gemm_wrapper

Support Hy4-preview (#36805 )

2026-09-04 18:03:49 -07:00

moe

[NVIDIA] Support flashinfer Mega Moe (#31470 )

2026-09-10 00:22:47 -07:00

quantization

[NVIDIA] Support flashinfer Mega Moe (#31470 )

2026-09-10 00:22:47 -07:00

rotary_embedding

support qwen 3.8 flash next (#37500 )

2026-09-08 13:56:21 -07:00

utils

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293 )

2026-09-07 15:39:34 -07:00

activation.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

amx_utils.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

attn_residual.py

[Fix]: exclude SM120 from attn-res TMA dispatch (#35361 )

2026-08-20 14:32:31 +08:00

aux_hidden_states.py

Improve CUDA graph and speculative execution output handling (#37329 )

2026-09-02 17:25:27 -07:00

clippable_linear.py

Add get_parallel(): a structured accessor for parallel-topology state (#28567 )

2026-06-17 20:23:43 -07:00

communicator_dsa_cp.py

[CP V1 Deprecation 4/5] Canonicalize prefill CP API names (#36229 )

2026-09-08 16:03:36 -07:00

communicator_mhc.py

GLM-5.3-Flash support (#36507 )

2026-09-06 02:27:59 -07:00

communicator.py

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

conv.py

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

dp_attention.py

[Bugfix] Keep a shared MAX_LEN prefill CUDA graph bucket when the graph captures a DP gather (MegaMoE sparse-DP hang) (#37933 )

2026-09-09 10:52:16 -07:00

flashinfer_comm_fusion.py

Use fp32 in TRTLLM all reduce buffers (#36143 )

2026-09-07 16:57:07 +08:00

flashinfer_mnnvl_cutedsl.py

[Comm] Drop the in-tree MNNVL CuTe DSL port in favor of FlashInfer 0.6.18 (#37206 )

2026-09-03 21:49:48 -07:00

hc_mix_triton.py

support qwen 3.8 flash next (#37500 )

2026-09-08 13:56:21 -07:00

hyperconnection.py

support qwen 3.8 flash next (#37500 )

2026-09-08 13:56:21 -07:00

int4fp8_utils.py

[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392 )

2026-01-14 01:44:40 -08:00

k3_ar_fusion.py

[Kimi-K3] Accept fp32 routing weights in the fused MoE finalize (#38612 )

2026-09-09 01:33:39 -07:00

k3_gemm_ar.py

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086 )

2026-08-30 02:18:33 -07:00

k3_sp_collective.py

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086 )

2026-08-30 02:18:33 -07:00

layernorm_sp.py

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

layernorm.py

[XPU] Add xpu forward in Gemma3RMSNorm & Add test and benchmark for Gemma3RMSNorm (#36278 )

2026-09-11 10:32:25 +08:00

linear.py

[1/N] Quantization Refactor: remove dead code and dedup the FP4 marlin helpers (#37552 )

2026-09-03 14:22:31 -07:00

logits_processor.py

[Sampling] Support sampling masks with overlap scheduling (#36631 )

2026-09-10 14:52:44 -07:00

logprob_processor.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

logsumexp.py

[perf] Compute input logprobs without materializing the full-vocab log-softmax (#31958 )

2026-08-07 14:01:08 -07:00

model_parallel.py

Extract leaf helpers out of ModelRunner into utility modules (#31146 )

2026-07-14 15:52:03 +08:00

modelopt_utils.py

[diffusion] fix: reject unsupported modelopt checkpoint algorithms (#35182 )

2026-08-20 09:13:24 +08:00

mova.py

[Model] Add native IFM K2 Horizon serving support (#37654 )

2026-09-03 16:39:43 +08:00

n_gram_embedding.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

parameter.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

pooler.py

model: support EmbeddingGemma (#32375 )

2026-07-27 10:40:47 +08:00

radix_attention.py

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

radix_linear_attention.py

Add Opt-In for GLM-5.3 Flash breakable prefill CUDA graphs (#38522 )

2026-09-09 17:02:08 -07:00

rocm_linear_utils.py

[AMD] Fix DLPack Error in Aiter flydsl GEMM by Detaching MoE Gate Weight (#22262 )

2026-04-07 23:42:10 -07:00

sampler.py

Fix custom logit processor params when num_tokens_in_batch is used (#38730 )

2026-09-10 17:52:08 -07:00

sparse_pooler.py

…

vocab_parallel_embedding.py

support qwen 3.8 flash next (#37500 )

2026-09-08 13:56:21 -07:00

zero_copy_context.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00