sglang

arg_groups

[NVIDIA] Support NVFP4 MoE for DeepSeek-V4 (#25820 )

2026-06-21 19:35:14 -07:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197 )

2026-06-09 09:22:09 +08:00

batch_overlap

[AMD][bugfix] Place TBO cuda-graph num_token_non_padded buffer on model devices (#28337 )

2026-06-20 18:06:22 -07:00

checkpoint_engine

…

compilation

fix(fa3): no NaN embeddings with fa_skip_kv_cache under piecewise CUDA graph (#27343 )

2026-06-15 13:46:22 -07:00

configs

[NVIDIA] Support NVFP4 MoE for DeepSeek-V4 (#25820 )

2026-06-21 19:35:14 -07:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

fix: prevent stale bitmask leakage in LLGuidance grammar backend (#23653 )

2026-06-13 13:27:08 -07:00

debug_utils

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984 )

2026-06-11 17:38:05 -07:00

disaggregation

Cap SWA pool sizing with chunk cache (#28755 )

2026-06-21 01:06:59 -07:00

distributed

Clean up startup log noise (#28807 )

2026-06-20 15:02:52 -07:00

dllm

Fix Req fill_len (fill_ids) having dual semantics by restricting to truncated/committed semantics (#26659 )

2026-06-08 14:52:48 +08:00

elastic_ep

chore: bump mooncake version to 0.3.11.post1 (#25989 )

2026-05-25 16:51:03 +08:00

entrypoints

fix(anthropic): handle mid-conversation system messages (#26773 )

2026-06-21 04:34:47 +00:00

eplb

[AMD] Fix no-op dtype cast in _topk_ids_logical_to_physical_dynamic on HIP (#28074 )

2026-06-20 11:07:22 -07:00

function_call

Support GLM-4.7 function calling via structural tags (#28149 )

2026-06-14 14:57:07 +08:00

grpc

[gRPC] Extract gRPC servicer into standalone package (#20478 )

2026-03-13 09:13:29 -07:00

hardware_backend

[Apple Silicon] [MLX] Fix MlxModelRunnerStub.initialize() signature desync with base (#28660 )

2026-06-19 18:05:22 -07:00

kv_canary

[Spec] Remove deprecated EAGLE v1 DRAFT_EXTEND forward mode (#28129 )

2026-06-13 13:00:21 -07:00

layers

[NVIDIA] Support NVFP4 MoE for DeepSeek-V4 (#25820 )

2026-06-21 19:35:14 -07:00

lora

[LoRA] Fix experimental fast-path multi-adapter correctness + flashinfer 0.6.12 compatibility (#28091 )

2026-06-19 16:20:19 -07:00

managers

[Feature] Add graceful scheduler shutdown; free hisparse host buffer on exit (#28779 )

2026-06-21 15:08:10 -07:00

mem_cache

[Feature] Add graceful scheduler shutdown; free hisparse host buffer on exit (#28779 )

2026-06-21 15:08:10 -07:00

model_executor

[PP] Pass DSA topk through PP warmup proxy buffers (#28785 )

2026-06-21 23:55:39 +08:00

model_loader

[NVIDIA] Support NVFP4 MoE for DeepSeek-V4 (#25820 )

2026-06-21 19:35:14 -07:00

models

[NVIDIA] Support NVFP4 MoE for DeepSeek-V4 (#25820 )

2026-06-21 19:35:14 -07:00

multimodal

[Fix] MM pool GPU alloc with base_gpu_id (#23377 )

2026-06-21 08:51:06 +08:00

multiplex

Move request-ingress methods to SchedulerRequestReceiver (#25610 )

2026-05-18 18:31:17 +08:00

observability

[observability] add Ray metric backend wrappers (#26252 )

2026-06-17 19:41:53 -07:00

parser

Fix Responses API request handling (#25881 )

2026-06-12 14:47:55 -07:00

platforms

Introduce CpuDeviceMixin and CpuSRTPlatform (#26385 )

2026-06-17 17:41:17 -07:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667 )

2026-05-30 02:19:50 -07:00

sampling

[Perf] Avoid per-decode-step host sync in min_new_tokens penalty (#28397 )

2026-06-15 23:32:28 -07:00

session

[perf] reduce overhead of fill_ids list reconstruction and decref (#27965 )

2026-06-14 00:41:11 -07:00

speculative

[Spec] Enable FR-Spec in EAGLE draft-extend CUDA graph by sizing logits buffer from the draft head (#28856 )

2026-06-21 15:35:57 -07:00

state_capturer

Fix routed-experts device buffer overflow under DP attention (#26123 )

2026-05-30 19:11:06 -07:00

tokenizer

…

utils

Cap SWA pool sizing with chunk cache (#28755 )

2026-06-21 01:06:59 -07:00

weight_sync

…

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

environ.py

[misc] Make NaN-logit sanitization opt-in (default off) (#28829 )

2026-06-21 14:31:35 -07:00

runtime_context.py

Add get_parallel(): a structured accessor for parallel-topology state (#28567 )

2026-06-17 20:23:43 -07:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094 )

2026-06-12 19:27:31 -07:00

server_args.py

Cap SWA pool sizing with chunk cache (#28755 )

2026-06-21 01:06:59 -07:00