sglang

arg_groups

config: the last runner-side instance reads read the bags

2026-08-15 00:37:06 -07:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197 )

2026-06-09 09:22:09 +08:00

batch_overlap

config: decisions keyed on the attention backend read the configured pair

2026-08-15 00:38:00 -07:00

checkpoint_engine

…

compilation

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

configs

[AMD][Spec] Accelerate Qwen3.5 verification with grouped-head shared KV (#34517 )

2026-08-15 00:15:52 -07:00

connector

…

constrained

[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217 )

2026-08-09 23:45:11 -07:00

debug_utils

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

disaggregation

vlm: cache kimi-k3 per-image processor artifacts (#34404 )

2026-08-16 19:51:13 +08:00

distributed

[NVIDIA] Add flashinfer MNNVL backend for allreduce only (#30700 )

2026-08-11 16:46:46 -07:00

dllm

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

elastic_ep

[Mooncake] Fix ProcessGroup API imports (#32403 )

2026-08-03 01:16:41 -07:00

entrypoints

Build Rust extensions on demand in source checkouts (#34994 )

2026-08-16 14:58:06 -07:00

eplb

config: the post-publish consumers of the supplied-instance surface read the bags

2026-08-15 00:39:35 -07:00

function_call

[Fix] Work around xgrammar 0.2.1 negative integer minimum in Kimi-K3 structural tags (#34778 )

2026-08-14 16:41:06 -07:00

hardware_backend

[NPU] Add mxfp4-w4a8 MOE Quantization Support for NPU (#30318 )

2026-08-16 14:03:17 +08:00

kv_canary

Radix Cache Split: Spin off TreeCore (#29901 )

2026-07-25 14:31:59 -07:00

layers

[misc] Rename shared-read boundary to shared-read ends and fix wrapper delegation (#34982 )

2026-08-16 14:36:31 -07:00

lora

config: the post-publish consumers of the supplied-instance surface read the bags

2026-08-15 00:39:35 -07:00

managers

[Spec] Support logprobs with DSpark speculative decoding (#34696 )

2026-08-16 15:05:13 -07:00

mem_cache

refactor(hicache): flatten L2 transfer execution (#34793 )

2026-08-16 00:33:34 -07:00

model_executor

Support model-defined prefill input embedding width (#35002 )

2026-08-16 15:08:19 -07:00

model_loader

fix: honor explicit model loader classes (#34880 )

2026-08-15 06:00:41 +00:00

models

vlm: cache kimi-k3 per-image processor artifacts (#34404 )

2026-08-16 19:51:13 +08:00

multimodal

Build Rust extensions on demand in source checkouts (#34994 )

2026-08-16 14:58:06 -07:00

multiplex

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

observability

metrics: don't clock-rebase unset time sentinels in ReqTimeStats deserialization (#34335 )

2026-08-12 14:27:47 +08:00

parser

[VLM] add content-addressed preprocessing cache infrastructure (#34398 )

2026-08-13 14:09:07 +08:00

platforms

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

plugins

…

ray

config: pass the Ray placement group as a launch argument

2026-08-05 19:28:39 -07:00

rust_extensions

Build Rust extensions on demand in source checkouts (#34994 )

2026-08-16 14:58:06 -07:00

sampling

Support thinking budget for Inkling (#33146 )

2026-08-11 02:01:08 +08:00

session

feat: add cache salt support to KV cache events (#30827 )

2026-08-12 16:14:04 -07:00

speculative

[Spec] Support logprobs with DSpark speculative decoding (#34696 )

2026-08-16 15:05:13 -07:00

state_capturer

[Fix: RL] Snapshot async state-capture outputs before overlap (#34319 )

2026-08-14 16:39:35 -07:00

tokenizer

Add Inkling model support (#31681 )

2026-07-19 22:57:37 -07:00

utils

Fix Whisper transcription for audio over 30 seconds (#33604 )

2026-08-15 23:51:05 +08:00

weight_cache

config: route parallel config-leaf reads through get_parallel() (#33170 )

2026-08-01 08:58:39 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

cuda_vmm_utils.py

Fix CUDA 13.0 VMM handle type compatibility (#34431 )

2026-08-11 15:16:34 -07:00

environ.py

Build Rust extensions on demand in source checkouts (#34994 )

2026-08-16 14:58:06 -07:00

runtime_context.py

config: the alias form of the runner-side instance read

2026-08-15 00:39:03 -07:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094 )

2026-06-12 19:27:31 -07:00

server_args.py

[Spec] Support mamba-radix-cache-strategy extra_buffer_lazy with DFLASH (#34763 )

2026-08-15 16:36:59 -07:00