sglang

arg_groups

Reland spec v2 tree drafting (eagle topk>1) with page_size==1 (#26866 ) (#26997 )

2026-06-03 15:40:05 -04:00

batch_invariant_ops

Register aten::rms_norm and aten::mm.dtype in batch invariant mode (#24459 )

2026-05-05 17:21:34 -07:00

batch_overlap

Remove dead fields and always-False plumbing across SB / FB / LogitsMetadata (#26551 )

2026-05-28 03:15:04 -07:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

Support piecewise CUDA graph with NSA (#23351 )

2026-05-22 14:39:50 -07:00

configs

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

[NPU]: Optimize xgrammar token bitmask on NPU with AscendC (#24133 )

2026-05-28 21:38:06 -07:00

debug_utils

Add a debug toggle for selectively reverting PR fixes (#26802 )

2026-05-31 09:50:12 +08:00

disaggregation

[PD] Deduplicate PD logprob normalization (#27085 )

2026-06-03 19:08:15 +08:00

distributed

[AMD] Enable AITER custom all-gather on ROCm (#25093 )

2026-06-02 15:57:37 -07:00

dllm

perf: migrate Req token-id storage to array.array('q') in Scheduler (#25098 )

2026-05-22 10:51:07 -07:00

elastic_ep

chore: bump mooncake version to 0.3.11.post1 (#25989 )

2026-05-25 16:51:03 +08:00

entrypoints

[3/N][Sync sglang-miles] TITO Support (#23751 )

2026-06-03 21:45:33 -04:00

eplb

[NPU] fix normal DeepEP mode num_tokens_per_rdma_rank error caused by none (#22972 )

2026-06-01 15:32:14 +08:00

function_call

model: support Command A plus (#26106 )

2026-06-03 11:23:04 +08:00

grpc

[gRPC] Extract gRPC servicer into standalone package (#20478 )

2026-03-13 09:13:29 -07:00

hardware_backend

fix(mlx): set canary_manager and materialize overlap-loop inputs on Apple Silicon (#26882 )

2026-06-04 00:03:46 +08:00

kv_canary

Add periodic KV-canary stats logging and kernel-run-counter health check (#26821 )

2026-05-31 10:00:19 +08:00

layers

[AMD] Fix TP2 DeepSeek-R1 nhead=64 MLA decode crash and add nightly coverage (#27188 )

2026-06-03 16:56:05 -07:00

lora

Fix MoE LoRA wrapper exposing moe_runner_config (#26710 )

2026-05-30 01:59:15 -07:00

managers

[UnifiedTree]: Support l3 storage for swa and deepseek v4 (#26881 )

2026-06-04 10:17:34 +08:00

mem_cache

[UnifiedTree]: Support l3 storage for swa and deepseek v4 (#26881 )

2026-06-04 10:17:34 +08:00

model_executor

Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091 )

2026-06-03 16:12:27 -07:00

model_loader

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

models

Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091 )

2026-06-03 16:12:27 -07:00

multimodal

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00

multiplex

Move request-ingress methods to SchedulerRequestReceiver (#25610 )

2026-05-18 18:31:17 +08:00

observability

Fix trace_modules gate disabling default trace contexts (#27173 )

2026-06-03 14:03:42 -04:00

parser

model: support Command A plus (#26106 )

2026-06-03 11:23:04 +08:00

platforms

[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821 )

2026-05-20 00:18:04 -07:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667 )

2026-05-30 02:19:50 -07:00

sampling

Add rids/bootstrap-room int-hash plumbing for deterministic per-request identification (#26814 )

2026-05-31 09:57:22 +08:00

session

[UnifiedRadixCache] Fix HiCache load back start node (#25088 )

2026-05-14 13:18:12 +08:00

speculative

Refactor simulated acceptance length generation (#26768 )

2026-06-03 18:31:32 -07:00

state_capturer

Fix routed-experts device buffer overflow under DP attention (#26123 )

2026-05-30 19:11:06 -07:00

tokenizer

…

utils

Add ZMQ IPv6 support, bench_serving sampling params, and reduce routed_dp_rank log noise (#27180 )

2026-06-03 17:49:34 -07:00

weight_sync

…

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

environ.py

Trigger scheduler diagnostics on health failure (#26757 )

2026-06-03 17:19:55 -07:00

server_args_config_parser.py

[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051 )

2026-01-16 15:32:42 +08:00

server_args.py

Trigger scheduler diagnostics on health failure (#26757 )

2026-06-03 17:19:55 -07:00