sglang

arg_groups

fix(dsv4): drop stale pp_size=1 guard for V4 PD disaggregation (#25771 )

2026-05-20 10:57:23 +08:00

batch_invariant_ops

Register aten::rms_norm and aten::mm.dtype in batch invariant mode (#24459 )

2026-05-05 17:21:34 -07:00

batch_overlap

[MoE] Unify DeepEPMoE+MoriEPMoE through AITER MoeRunner pre/post-permute (#23760 )

2026-05-17 02:25:52 -07:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

chore: add vLLM SPDX copyright headers to ported files (#25182 )

2026-05-13 15:17:30 -07:00

configs

Add output_gate_type to Qwen3NextConfig and update models to utilize it (#25401 )

2026-05-19 00:18:08 +08:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

feat(constrained): two-phase reasoning grammar + --enable-strict-thinking (#23953 )

2026-05-07 14:21:51 -07:00

debug_utils

Add e2e test with log snapshot in dumper grafter (#24513 )

2026-05-06 17:00:13 +08:00

disaggregation

[PD] Clean early abort logic in PD module (#25677 )

2026-05-20 11:17:42 +08:00

distributed

[PD] Un-blacklist mooncake sessions when probe succeeds (#25287 )

2026-05-20 11:16:28 +08:00

dllm

Fix the misnamed request finish-check method to reflect its mutating semantics (#25725 )

2026-05-19 09:22:28 +08:00

elastic_ep

[6/N] (Elastic EP) Recover failed ranks (#15771 )

2026-04-28 00:44:26 -07:00

entrypoints

Fix PD disaggregation warmup: set request_name and improve error logging (#25542 )

2026-05-18 09:49:56 -07:00

eplb

Replace hardcoded CUDA device with get_device() for XPU support (#13599 )

2026-05-01 07:13:46 +08:00

function_call

[Fix] DeepSeek-V3.2: build structural tag locally to encode both wrapper and invoke layers (#25233 )

2026-05-15 14:32:50 -07:00

grpc

[gRPC] Extract gRPC servicer into standalone package (#20478 )

2026-03-13 09:13:29 -07:00

hardware_backend

drop output ids (#25774 )

2026-05-19 17:50:47 -07:00

layers

[Intel GPU]Support fused_topk for XPU (#24641 )

2026-05-20 10:34:29 +08:00

lora

Deprecate record_nolora_graph dual MoE CUDA graph capture (#24314 )

2026-05-15 19:20:58 -07:00

managers

[PD] Clean early abort logic in PD module (#25677 )

2026-05-20 11:17:42 +08:00

mem_cache

[HiSparse & PD] Support hisparse memory pool host page > 1 (#23606 )

2026-05-19 01:29:35 -07:00

model_executor

fix(dsv4): make pool configurator PP-aware (#25750 )

2026-05-20 10:58:53 +08:00

model_loader

Delegate ModelExpress loading to package (#24723 )

2026-05-16 11:16:44 -07:00

models

DeepSeek V4 MTP Support CP (#24934 )

2026-05-19 16:51:31 -07:00

multimodal

perf(mimo-v2-epd): enable GPU image preprocess and parallel video decode (#25588 )

2026-05-19 11:47:21 +08:00

multiplex

Move request-ingress methods to SchedulerRequestReceiver (#25610 )

2026-05-18 18:31:17 +08:00

observability

Add spec_verify_calls_total metric for speculative decoding (#25689 )

2026-05-18 18:35:11 -07:00

parser

[fix] skip legacy minicpmv conv template for MiniCPM-V 4.6 (#24998 )

2026-05-12 15:27:28 +08:00

platforms

Introduce CudaDeviceMixin and CudaSRTPlatform (#24096 )

2026-05-15 10:59:02 -07:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

Bundle Scheduler rank/size fields into a frozen ParallelState (#25444 )

2026-05-16 09:23:51 +08:00

sampling

Reject repetition_penalty=0 in SamplingParams.verify() (#24874 )

2026-05-12 21:25:23 -07:00

session

[UnifiedRadixCache] Fix HiCache load back start node (#25088 )

2026-05-14 13:18:12 +08:00

speculative

[BugFix] Resolve adaptive speculative decoding conflicts for Qwen3.5 (hybrid GDN) (#23331 )

2026-05-19 15:09:49 -07:00

state_capturer

[Session R3] Add routed_experts_start_len for absolute routing slice control (#24851 )

2026-05-10 10:04:43 -07:00

tokenizer

…

utils

perf(mimo-v2-epd): enable GPU image preprocess and parallel video decode (#25588 )

2026-05-19 11:47:21 +08:00

weight_sync

…

constants.py

Clean up detokenizer and remove dead multimodal_gen code (#21588 )

2026-03-28 21:44:40 -07:00

environ.py

[PD] Un-blacklist mooncake sessions when probe succeeds (#25287 )

2026-05-20 11:16:28 +08:00

server_args_config_parser.py

[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051 )

2026-01-16 15:32:42 +08:00

server_args.py

[BugFix] Resolve adaptive speculative decoding conflicts for Qwen3.5 (hybrid GDN) (#23331 )

2026-05-19 15:09:49 -07:00