sglang

arg_groups

Nemotron perf changes (#26733 )

2026-06-05 22:31:46 -07:00

batch_invariant_ops

Register aten::rms_norm and aten::mm.dtype in batch invariant mode (#24459 )

2026-05-05 17:21:34 -07:00

batch_overlap

[Bugfix] Restore overridden HF config fields and support index_skip_topk_offset for DSA topk sharing (#27114 )

2026-06-06 13:26:04 +08:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

Support piecewise CUDA graph with NSA (#23351 )

2026-05-22 14:39:50 -07:00

configs

[plugin] default device detection fixes for OOT platform plugins (#25337 )

2026-06-06 07:55:50 +08:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

[NPU]: Optimize xgrammar token bitmask on NPU with AscendC (#24133 )

2026-05-28 21:38:06 -07:00

debug_utils

[CI] Isolate CUDA coredump dir per run to fix tracker mis-attribution (#27344 )

2026-06-05 21:31:22 -04:00

disaggregation

[PD] Fix KV cache corruption on abort by notifying ongoing prefill (#27372 )

2026-06-06 00:56:13 +08:00

distributed

[AMD] Enable AITER custom all-gather on ROCm (#25093 )

2026-06-02 15:57:37 -07:00

dllm

perf: migrate Req token-id storage to array.array('q') in Scheduler (#25098 )

2026-05-22 10:51:07 -07:00

elastic_ep

chore: bump mooncake version to 0.3.11.post1 (#25989 )

2026-05-25 16:51:03 +08:00

entrypoints

[3/N][Sync sglang-miles] TITO Support (#23751 )

2026-06-03 21:45:33 -04:00

eplb

[NPU] fix normal DeepEP mode num_tokens_per_rdma_rank error caused by none (#22972 )

2026-06-01 15:32:14 +08:00

function_call

model: support Command A plus (#26106 )

2026-06-03 11:23:04 +08:00

grpc

[gRPC] Extract gRPC servicer into standalone package (#20478 )

2026-03-13 09:13:29 -07:00

hardware_backend

Replace skip_attn_backend_init with a batch-carried attention plan marker (+ staleness re-plan) (#27193 )

2026-06-04 17:13:18 -07:00

kv_canary

Add kv_canary PP self-test fixture and SWA divergence coverage (#27410 )

2026-06-06 09:06:19 +08:00

layers

[Cohere2Moe] Enable flashinfer_trtllm NVFP4 fused-MoE via SigmoidRenorm routing (#27401 )

2026-06-05 22:49:20 -07:00

lora

[LoRA] Experimental fast LoRA path with experimental_sgl_trtllm MoE backend for FP8 and NVFP4 models (#27329 )

2026-06-05 14:45:59 -07:00

managers

Add scripted-runtime harness core and wire scheduler/IPC hooks (#27411 )

2026-06-06 09:07:01 +08:00

mem_cache

[BugFix]: Fix HiMamba HiCache prefetch hang after L3 sidecar transfer (#27366 )

2026-06-05 20:37:40 +08:00

model_executor

Optimize ngram decode token table update (#24756 )

2026-06-06 14:13:45 +08:00

model_loader

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

models

[Cohere2Moe] Enable flashinfer_trtllm NVFP4 fused-MoE via SigmoidRenorm routing (#27401 )

2026-06-05 22:49:20 -07:00

multimodal

[model] support encoder-free unified Text/Vision/Audio model (#27167 )

2026-06-03 23:58:06 +08:00

multiplex

Move request-ingress methods to SchedulerRequestReceiver (#25610 )

2026-05-18 18:31:17 +08:00

observability

Fix trace_modules gate disabling default trace contexts (#27173 )

2026-06-03 14:03:42 -04:00

parser

model: support Command A plus (#26106 )

2026-06-03 11:23:04 +08:00

platforms

[plugin] default device detection fixes for OOT platform plugins (#25337 )

2026-06-06 07:55:50 +08:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667 )

2026-05-30 02:19:50 -07:00

sampling

Add rids/bootstrap-room int-hash plumbing for deterministic per-request identification (#26814 )

2026-05-31 09:57:22 +08:00

session

Plug mamba_extra_buffer ping-pong slot leaks (#26941 )

2026-06-04 21:46:36 +08:00

speculative

[Bugfix] Restore overridden HF config fields and support index_skip_topk_offset for DSA topk sharing (#27114 )

2026-06-06 13:26:04 +08:00

state_capturer

Fix routed-experts device buffer overflow under DP attention (#26123 )

2026-05-30 19:11:06 -07:00

tokenizer

…

utils

[Bugfix] Restore overridden HF config fields and support index_skip_topk_offset for DSA topk sharing (#27114 )

2026-06-06 13:26:04 +08:00

weight_sync

…

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

environ.py

[CI] Isolate CUDA coredump dir per run to fix tracker mis-attribution (#27344 )

2026-06-05 21:31:22 -04:00

server_args_config_parser.py

…

server_args.py

[Bugfix] Restore overridden HF config fields and support index_skip_topk_offset for DSA topk sharing (#27114 )

2026-06-06 13:26:04 +08:00