sglang

attention

Clean deprecated DeepSeek V4 Environs (#34926 )

2026-08-17 16:07:00 -07:00

cp

config: spell out the one dynamic config read the census could not see

2026-08-15 00:38:30 -07:00

dcp

[DCP] Share one pack kernel between both a2a backends (#34651 )

2026-08-13 15:06:02 -07:00

deep_gemm_wrapper

config: the post-publish consumers of the supplied-instance surface read the bags

2026-08-15 00:39:35 -07:00

moe

Clean deprecated DeepSeek V4 Environs (#34926 )

2026-08-17 16:07:00 -07:00

quantization

[NPU] Support DeepSeek-V4 DSpark and refactor DSV4 cache management (#33676 )

2026-08-17 16:27:44 +08:00

rotary_embedding

[CPU] Add support for Gemma4 on Xeon (#22498 )

2026-08-17 10:52:26 +08:00

utils

[AMD] Support prefill context parallel two batch overlap for DeepSeek V4 (#33480 )

2026-08-16 22:40:29 -07:00

activation.py

[Kimi-K3][NPU] Support Kimi-K3 on NPU (#33465 )

2026-08-12 21:20:14 +08:00

amx_utils.py

[CPU][QUANT] add amx cpu support for auto-round (#29593 )

2026-08-13 15:50:59 +08:00

attn_residual.py

[Kimi-K3][NPU] Support Kimi-K3 on NPU (#33465 )

2026-08-12 21:20:14 +08:00

aux_hidden_states.py

Pack aux hidden states into a preallocated buffer (#28956 )

2026-07-28 04:37:18 -07:00

clippable_linear.py

Add get_parallel(): a structured accessor for parallel-topology state (#28567 )

2026-06-17 20:23:43 -07:00

communicator_dsa_cp.py

[Feat][GLM5.2] Add DSA Cache Layer Split under Prefill CP (#29421 )

2026-07-09 03:03:56 -07:00

communicator.py

[NVIDIA] Add flashinfer MNNVL backend for allreduce only (#30700 )

2026-08-11 16:46:46 -07:00

conv.py

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

dp_attention.py

[AMD] Support prefill context parallel two batch overlap for DeepSeek V4 (#33480 )

2026-08-16 22:40:29 -07:00

flashinfer_comm_fusion.py

Suppress expected FlashInfer TRT-LLM workspace warnings (#34921 )

2026-08-17 15:16:16 +08:00

int4fp8_utils.py

[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392 )

2026-01-14 01:44:40 -08:00

k3_ar_fusion.py

config: business code no longer reads the published ServerArgs (#34081 )

2026-08-09 14:44:08 -07:00

k3_gemm_ar.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

k3_sp_collective.py

config: retire the alias-form process-global config reads

2026-08-05 19:29:20 -07:00

layernorm.py

[CPU] Add support for Gemma4 on Xeon (#22498 )

2026-08-17 10:52:26 +08:00

linear.py

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

logits_processor.py

Optimize FP32 LM head for bf16/fp16 (#32370 )

2026-08-11 15:14:50 -07:00

logprob_processor.py

[Spec] Simplify compute_spec_v2_logprobs signature and skip identity gathers (#35058 )

2026-08-16 16:01:26 -07:00

logsumexp.py

[perf] Compute input logprobs without materializing the full-vocab log-softmax (#31958 )

2026-08-07 14:01:08 -07:00

model_parallel.py

Extract leaf helpers out of ModelRunner into utility modules (#31146 )

2026-07-14 15:52:03 +08:00

modelopt_utils.py

…

n_gram_embedding.py

Fix Nightly NV CI (#33564 )

2026-08-05 18:06:47 -07:00

parameter.py

[Quantization] add humming quantization kernel (#23754 )

2026-07-14 08:42:56 +08:00

pooler.py

model: support EmbeddingGemma (#32375 )

2026-07-27 10:40:47 +08:00

radix_attention.py

Fix padded positions in breakable CUDA Graph attention (#33253 )

2026-08-05 15:53:28 -07:00

radix_linear_attention.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

rocm_linear_utils.py

[AMD] Fix DLPack Error in Aiter flydsl GEMM by Detaching MoE Gate Weight (#22262 )

2026-04-07 23:42:10 -07:00

sampler.py

[AMD][Fix] Qwen3.5: guard zero-grid launch in fused_qk_gemma_rmsnorm(_with_gate) (HIP invalid configuration on idle DP rank) (#31794 )

2026-08-15 21:02:54 -07:00

sparse_pooler.py

…

vocab_parallel_embedding.py

[Quantization] Fix GPTQ scheme attachment broken by LinearBase.scheme default (#34962 )

2026-08-16 00:48:02 -07:00

zero_copy_context.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00