sglang

arg_groups

config: retire ServerArgs.override in favour of derive()

2026-08-05 19:30:53 -07:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197 )

2026-06-09 09:22:09 +08:00

batch_overlap

config: retire the last process-global config field reads (#33338 )

2026-08-02 21:24:42 -07:00

checkpoint_engine

…

compilation

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

configs

[HiCache] Support packed and sidecar draft caches for MTP/EAGLE/DSpark (#30393 )

2026-08-06 14:31:11 +08:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

[Fix] Treat an empty grammar constraint as unset in SamplingParams (#33328 )

2026-08-02 21:45:51 -07:00

debug_utils

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

disaggregation

[Disagg][StagingBuffer][2/2] Support radix cache (#30545 )

2026-08-06 23:59:35 +08:00

distributed

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

dllm

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

elastic_ep

[Mooncake] Fix ProcessGroup API imports (#32403 )

2026-08-03 01:16:41 -07:00

entrypoints

config: template-detected parsers go to the engine's control-plane overlay

2026-08-05 19:29:51 -07:00

eplb

config: route parallel config-leaf reads through get_parallel() (#33170 )

2026-08-01 08:58:39 -07:00

function_call

[Kimi K3] Add reasoning, tool-call, and OpenAI serving support (#33025 )

2026-08-01 14:57:23 -07:00

grpc

…

hardware_backend

[NPU] Add causal conv1d (#28267 )

2026-08-05 22:22:49 +08:00

kv_canary

Radix Cache Split: Spin off TreeCore (#29901 )

2026-07-25 14:31:59 -07:00

layers

[NVIDIA] Enable CuTe DSL BF16 GEMM on SM107 (#33617 )

2026-08-06 02:06:08 -07:00

lora

[LoRA] Laguna: per-layer LoRA hidden-dim resolution for packed attention (#30298 )

2026-08-04 14:48:05 -07:00

managers

[Disagg][StagingBuffer][2/2] Support radix cache (#30545 )

2026-08-06 23:59:35 +08:00

mem_cache

Remove revoke queue after hit-then-alloc refactoring (#33613 )

2026-08-06 03:10:10 -07:00

model_executor

Profiling Enhancements [1/3]: cuda graph profile traces (#24370 )

2026-08-06 03:19:35 -07:00

model_loader

Support ModelOpt MXFP8 checkpoints (#32538 )

2026-08-05 17:44:32 -07:00

models

Facade DSA index-cache: MTP topk-reuse state + index-K storage (#28609 )

2026-08-06 00:34:31 -07:00

multimodal

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

multiplex

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

observability

Observability enhancement for HiCache (#32388 )

2026-08-05 14:13:06 -07:00

parser

config: retire ServerArgs.override in favour of derive()

2026-08-05 19:30:53 -07:00

platforms

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

plugins

…

ray

config: pass the Ray placement group as a launch argument

2026-08-05 19:28:39 -07:00

sampling

[Docs] Rename docs_new/ to docs/ (#32123 )

2026-08-03 16:51:00 -07:00

session

feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173 )

2026-08-02 13:43:55 +08:00

speculative

Fix lint error (#33830 )

2026-08-06 00:53:40 -07:00

state_capturer

config: route parallel config-leaf reads through get_parallel() (#33170 )

2026-08-01 08:58:39 -07:00

tokenizer

Add Inkling model support (#31681 )

2026-07-19 22:57:37 -07:00

utils

Profiling Enhancements [1/3]: cuda graph profile traces (#24370 )

2026-08-06 03:19:35 -07:00

weight_cache

config: route parallel config-leaf reads through get_parallel() (#33170 )

2026-08-01 08:58:39 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

environ.py

Profiling Enhancements [1/3]: cuda graph profile traces (#24370 )

2026-08-06 03:19:35 -07:00

runtime_context.py

config: resolve the draft worker's config per runner, not on a copy

2026-08-05 19:31:23 -07:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094 )

2026-06-12 19:27:31 -07:00

server_args.py

Gate multimodal feature transport by model capability (#33653 )

2026-08-06 06:48:32 -07:00