sglang

arg_groups

Support topk > 1 tree drafting for mamba/hybrid-linear models on spec v2 (#27463 )

2026-06-07 17:04:09 -07:00

batch_invariant_ops

Register aten::rms_norm and aten::mm.dtype in batch invariant mode (#24459 )

2026-05-05 17:21:34 -07:00

batch_overlap

[Bugfix] Restore overridden HF config fields and support index_skip_topk_offset for DSA topk sharing (#27114 )

2026-06-06 13:26:04 +08:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

[AMD] Enable Piecewise CUDA Graph for AMD GPUs (#22299 )

2026-06-07 16:28:20 -07:00

configs

[plugin] default device detection fixes for OOT platform plugins (#25337 )

2026-06-06 07:55:50 +08:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

[NPU]: Optimize xgrammar token bitmask on NPU with AscendC (#24133 )

2026-05-28 21:38:06 -07:00

debug_utils

Speed up dump comparator percentile computation using numpy (#26874 )

2026-06-08 14:50:31 +08:00

disaggregation

[EPD] Dynamic encoder registration cleanup (#27542 )

2026-06-08 19:08:29 +08:00

distributed

Add all_to_all_single to GroupCoordinator (#27492 )

2026-06-07 02:48:47 -07:00

dllm

Fix Req fill_len (fill_ids) having dual semantics by restricting to truncated/committed semantics (#26659 )

2026-06-08 14:52:48 +08:00

elastic_ep

chore: bump mooncake version to 0.3.11.post1 (#25989 )

2026-05-25 16:51:03 +08:00

entrypoints

Classify malformed-multimodal rejects as invalid_request (#27451 )

2026-06-06 10:19:22 -07:00

eplb

[NPU] fix normal DeepEP mode num_tokens_per_rdma_rank error caused by none (#22972 )

2026-06-01 15:32:14 +08:00

function_call

[model] Apertus Tool/Function and Reasoning parser (#25100 )

2026-06-06 00:04:31 -07:00

grpc

[gRPC] Extract gRPC servicer into standalone package (#20478 )

2026-03-13 09:13:29 -07:00

hardware_backend

[GPTQ] Refactor CPU quantization schemes (#26786 )

2026-06-08 13:14:40 +03:00

kv_canary

Add kv_canary PP self-test fixture and SWA divergence coverage (#27410 )

2026-06-06 09:06:19 +08:00

layers

[ROCm] dsv4: remove the redundant fp8 scale transpose-copy on decode (#27289 )

2026-06-08 11:49:34 -07:00

lora

[LoRA] Experimental fast LoRA path with experimental_sgl_trtllm MoE backend for FP8 and NVFP4 models (#27329 )

2026-06-05 14:45:59 -07:00

managers

[srt] Add sglang:weight_load_duration_seconds gauge with source label (#27363 )

2026-06-08 23:41:54 +08:00

mem_cache

[HiCache][Dsv4] Don't cache C128 State pool in L3 (#27293 )

2026-06-08 21:23:26 +08:00

model_executor

Support encoder_decoder on cpu_graph_runner (#10950 )

2026-06-08 10:30:11 +08:00

model_loader

[NVIDIA] Fix FP8 gemm performance with fp16 models (MInimax-M2.5) (#22300 )

2026-06-07 02:45:00 +00:00

models

[ROCm] dsv4: remove the redundant fp8 scale transpose-copy on decode (#27289 )

2026-06-08 11:49:34 -07:00

multimodal

Classify malformed-multimodal rejects as invalid_request (#27451 )

2026-06-06 10:19:22 -07:00

multiplex

Move request-ingress methods to SchedulerRequestReceiver (#25610 )

2026-05-18 18:31:17 +08:00

observability

[srt] Add sglang:weight_load_duration_seconds gauge with source label (#27363 )

2026-06-08 23:41:54 +08:00

parser

[model] Apertus Tool/Function and Reasoning parser (#25100 )

2026-06-06 00:04:31 -07:00

platforms

[plugin] enable OOT platforms to provide custom quant configs (#25347 )

2026-06-07 12:48:55 +08:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667 )

2026-05-30 02:19:50 -07:00

sampling

Fix Req array token-id concatenation (#26182 )

2026-06-06 19:59:51 -07:00

session

Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637 )

2026-06-08 14:52:18 +08:00

speculative

[spec] Misc defensive guards for EAGLE draft KV indexing (#27486 )

2026-06-07 21:27:46 -07:00

state_capturer

Fix routed-experts device buffer overflow under DP attention (#26123 )

2026-05-30 19:11:06 -07:00

tokenizer

…

utils

Fix port overflow in DP attention path when base port is near 65535 (#20260 )

2026-06-08 00:39:29 -07:00

weight_sync

…

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

environ.py

[EPD] Support dynamic encoder register (#22253 )

2026-06-08 16:05:16 +08:00

server_args_config_parser.py

[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051 )

2026-01-16 15:32:42 +08:00

server_args.py

[EPD] Support dynamic encoder register (#22253 )

2026-06-08 16:05:16 +08:00