sglang

arg_groups

Support speculative decoding on CPU (#27862 )

2026-07-09 10:27:09 +08:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197 )

2026-06-09 09:22:09 +08:00

batch_overlap

[refactor] Read resolved config from server_args fields; retire the flags mirror tier (#30346 )

2026-07-07 21:28:34 -07:00

checkpoint_engine

…

compilation

[Intel GPU] xpu_piecewise: fall back to eager when PCG capture stream is unset (#30235 )

2026-07-09 10:21:43 +08:00

configs

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

[refactor] Move model-capability adjustments into the resolution pipeline (#30299 )

2026-07-07 21:26:55 -07:00

debug_utils

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

disaggregation

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

distributed

[AMD] Fix AITER custom all-gather CUDA-graph capture crash under torch_memory_saver (#30557 )

2026-07-09 01:30:51 -07:00

dllm

Inline extend_range accessors and remove the extend_input_len/fill_len properties (#27611 )

2026-06-25 08:56:44 +08:00

elastic_ep

[refactor] Move the EP dispatcher and fusion-workspace manager state onto ctx.resources (#30489 )

2026-07-09 02:08:35 -07:00

entrypoints

Move template manager files under parser; update CODEOWNERS (#26052 )

2026-07-08 16:47:36 -07:00

eplb

[refactor] ctx.resources: named slots, stream leases, and workspace buffer leases (#30348 )

2026-07-07 21:30:10 -07:00

function_call

feat(parser): resolve special-token suffix at runtime for compatibility (#29920 )

2026-07-05 00:13:46 +08:00

grpc

…

hardware_backend

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

kv_canary

[Spec] Remove deprecated EAGLE v1 DRAFT_EXTEND forward mode (#28129 )

2026-06-13 13:00:21 -07:00

layers

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

lora

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

managers

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

mem_cache

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

model_executor

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

model_loader

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

models

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

multimodal

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

multiplex

Move request-ingress methods to SchedulerRequestReceiver (#25610 )

2026-05-18 18:31:17 +08:00

observability

feat(metrics): add Prometheus metrics for the EPD encoder server (#27564 )

2026-07-07 12:04:51 +08:00

parser

Move template manager files under parser; update CODEOWNERS (#26052 )

2026-07-08 16:47:36 -07:00

platforms

Introduce CpuDeviceMixin and CpuSRTPlatform (#26385 )

2026-06-17 17:41:17 -07:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

[refactor] Move model-capability adjustments into the resolution pipeline (#30299 )

2026-07-07 21:26:55 -07:00

sampling

Convert IPC dataclasses to msgspec.Struct with opt-in msgpack transport (#28688 )

2026-06-26 12:04:03 -07:00

session

feat: first-class session identity in SGLang (#29436 )

2026-06-28 07:16:38 -07:00

speculative

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

state_capturer

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

tokenizer

…

utils

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

weight_sync

…

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

environ.py

[refactor] Move model-capability adjustments into the resolution pipeline (#30299 )

2026-07-07 21:26:55 -07:00

runtime_context.py

[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492 )

2026-07-09 02:09:39 -07:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094 )

2026-06-12 19:27:31 -07:00

server_args.py

Disable multi-threaded load by default when prefetch is on (#30146 )

2026-07-09 00:28:53 -07:00