sglang

arg_groups

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00

batch_invariant_ops

Register aten::rms_norm and aten::mm.dtype in batch invariant mode (#24459 )

2026-05-05 17:21:34 -07:00

batch_overlap

Remove dead fields and always-False plumbing across SB / FB / LogitsMetadata (#26551 )

2026-05-28 03:15:04 -07:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

Support piecewise CUDA graph with NSA (#23351 )

2026-05-22 14:39:50 -07:00

configs

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

[NPU]: Optimize xgrammar token bitmask on NPU with AscendC (#24133 )

2026-05-28 21:38:06 -07:00

debug_utils

Add a debug toggle for selectively reverting PR fixes (#26802 )

2026-05-31 09:50:12 +08:00

disaggregation

[PD] Deduplicate PD logprob normalization (#27085 )

2026-06-03 19:08:15 +08:00

distributed

[AMD] Enable AITER custom all-gather on ROCm (#25093 )

2026-06-02 15:57:37 -07:00

dllm

perf: migrate Req token-id storage to array.array('q') in Scheduler (#25098 )

2026-05-22 10:51:07 -07:00

elastic_ep

chore: bump mooncake version to 0.3.11.post1 (#25989 )

2026-05-25 16:51:03 +08:00

entrypoints

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00

eplb

[NPU] fix normal DeepEP mode num_tokens_per_rdma_rank error caused by none (#22972 )

2026-06-01 15:32:14 +08:00

function_call

model: support Command A plus (#26106 )

2026-06-03 11:23:04 +08:00

grpc

[gRPC] Extract gRPC servicer into standalone package (#20478 )

2026-03-13 09:13:29 -07:00

hardware_backend

[refactor] init_forward_metadata 3-method ABC + side-channel removal + ForwardMetadata type rename (#26735 )

2026-06-02 10:33:33 -07:00

kv_canary

Add periodic KV-canary stats logging and kernel-run-counter health check (#26821 )

2026-05-31 10:00:19 +08:00

layers

Revert "Support NextN = 2/4 in DSV32" (#27138 )

2026-06-03 01:29:52 -07:00

lora

Fix MoE LoRA wrapper exposing moe_runner_config (#26710 )

2026-05-30 01:59:15 -07:00

managers

[PD] Deduplicate PD logprob normalization (#27085 )

2026-06-03 19:08:15 +08:00

mem_cache

[HiCache] fix: truncate prefetch key on degraded allocation (#25991 )

2026-06-03 22:06:18 +08:00

model_executor

Fix flashinfer autotune oom glm51 (#24195 )

2026-06-02 23:28:57 -07:00

model_loader

Add per-rank staggered weight loading for improved TP I/O concurrency (#26937 )

2026-06-03 11:25:21 +08:00

models

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00

multimodal

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00

multiplex

Move request-ingress methods to SchedulerRequestReceiver (#25610 )

2026-05-18 18:31:17 +08:00

observability

[SGLang Tracing] Add pd disaggregation mooncake backend tracing (#23755 )

2026-06-03 16:43:29 +08:00

parser

model: support Command A plus (#26106 )

2026-06-03 11:23:04 +08:00

platforms

[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821 )

2026-05-20 00:18:04 -07:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667 )

2026-05-30 02:19:50 -07:00

sampling

Add rids/bootstrap-room int-hash plumbing for deterministic per-request identification (#26814 )

2026-05-31 09:57:22 +08:00

session

[UnifiedRadixCache] Fix HiCache load back start node (#25088 )

2026-05-14 13:18:12 +08:00

speculative

[DP] Fix FlashInfer dispatcher workspace sizing and set_dp_buffer_len (#26643 )

2026-06-02 13:25:20 -07:00

state_capturer

Fix routed-experts device buffer overflow under DP attention (#26123 )

2026-05-30 19:11:06 -07:00

tokenizer

…

utils

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00

weight_sync

…

constants.py

Clean up detokenizer and remove dead multimodal_gen code (#21588 )

2026-03-28 21:44:40 -07:00

environ.py

integrate flash_mla_sparse_fwd (#25418 )

2026-06-03 01:09:25 -07:00

server_args_config_parser.py

[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051 )

2026-01-16 15:32:42 +08:00

server_args.py

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00