sglang

arg_groups

Clean deprecated DeepSeek V4 Environs (#34926 )

2026-08-17 16:07:00 -07:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197 )

2026-06-09 09:22:09 +08:00

batch_overlap

[AMD] Support prefill context parallel two batch overlap for DeepSeek V4 (#33480 )

2026-08-16 22:40:29 -07:00

checkpoint_engine

…

compilation

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

configs

[DSA] Skip indexer KV cache for skip-topk layers (#30531 )

2026-08-17 02:02:23 -07:00

connector

…

constrained

[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217 )

2026-08-09 23:45:11 -07:00

debug_utils

spec: size the speculative buffers from the bags, not the startup record (#35024 )

2026-08-17 16:16:56 -07:00

disaggregation

spec: size the speculative buffers from the bags, not the startup record (#35024 )

2026-08-17 16:16:56 -07:00

distributed

[Fix] Read the DSA prefill CP flag from the parallel config bag in bootstrap (#35110 )

2026-08-17 00:21:41 -07:00

dllm

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

elastic_ep

[Mooncake] Fix ProcessGroup API imports (#32403 )

2026-08-03 01:16:41 -07:00

entrypoints

config: publish before a process reads configuration (#35023 )

2026-08-17 16:16:20 -07:00

eplb

Add explicit EPLB balancedness reporting modes (#34998 )

2026-08-16 15:31:11 -07:00

function_call

[Fix] Work around xgrammar 0.2.1 negative integer minimum in Kimi-K3 structural tags (#34778 )

2026-08-14 16:41:06 -07:00

hardware_backend

[NPU] Support DeepSeek-V4 DSpark and refactor DSV4 cache management (#33676 )

2026-08-17 16:27:44 +08:00

kv_canary

Radix Cache Split: Spin off TreeCore (#29901 )

2026-07-25 14:31:59 -07:00

layers

spec: size the speculative buffers from the bags, not the startup record (#35024 )

2026-08-17 16:16:56 -07:00

lora

config: the post-publish consumers of the supplied-instance surface read the bags

2026-08-15 00:39:35 -07:00

managers

spec: size the speculative buffers from the bags, not the startup record (#35024 )

2026-08-17 16:16:56 -07:00

mem_cache

spec: size the speculative buffers from the bags, not the startup record (#35024 )

2026-08-17 16:16:56 -07:00

model_executor

spec: size the speculative buffers from the bags, not the startup record (#35024 )

2026-08-17 16:16:56 -07:00

model_loader

fix: honor explicit model loader classes (#34880 )

2026-08-15 06:00:41 +00:00

models

Clean deprecated DeepSeek V4 Environs (#34926 )

2026-08-17 16:07:00 -07:00

multimodal

Build Rust extensions on demand in source checkouts (#34994 )

2026-08-16 14:58:06 -07:00

multiplex

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

observability

Add explicit EPLB balancedness reporting modes (#34998 )

2026-08-16 15:31:11 -07:00

parser

[VLM] add content-addressed preprocessing cache infrastructure (#34398 )

2026-08-13 14:09:07 +08:00

platforms

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

plugins

…

ray

config: publish before a process reads configuration (#35023 )

2026-08-17 16:16:20 -07:00

rust_extensions

Build Rust extensions on demand in source checkouts (#34994 )

2026-08-16 14:58:06 -07:00

sampling

Support thinking budget for Inkling (#33146 )

2026-08-11 02:01:08 +08:00

session

feat: add cache salt support to KV cache events (#30827 )

2026-08-12 16:14:04 -07:00

speculative

spec: size the speculative buffers from the bags, not the startup record (#35024 )

2026-08-17 16:16:56 -07:00

state_capturer

[Fix: RL] Snapshot async state-capture outputs before overlap (#34319 )

2026-08-14 16:39:35 -07:00

tokenizer

Add Inkling model support (#31681 )

2026-07-19 22:57:37 -07:00

utils

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

weight_cache

config: route parallel config-leaf reads through get_parallel() (#33170 )

2026-08-01 08:58:39 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

cuda_vmm_utils.py

Fix CUDA 13.0 VMM handle type compatibility (#34431 )

2026-08-11 15:16:34 -07:00

environ.py

Clean deprecated DeepSeek V4 Environs (#34926 )

2026-08-17 16:07:00 -07:00

runtime_context.py

config: publish before a process reads configuration (#35023 )

2026-08-17 16:16:20 -07:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094 )

2026-06-12 19:27:31 -07:00

server_args.py

Clean deprecated DeepSeek V4 Environs (#34926 )

2026-08-17 16:07:00 -07:00