sglang

arg_groups

[GDN] Amortize ReplaySSM checkpoint materialization (#35544 )

2026-09-04 15:13:20 -07:00

batch_invariant_ops

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

batch_overlap

[Fix] Coordinate FullCG prefix variants across DP ranks (#37888 )

2026-09-04 11:29:30 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

checkpoint_engine

…

compilation

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

configs

[GDN] Amortize ReplaySSM checkpoint materialization (#35544 )

2026-09-04 15:13:20 -07:00

connector

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

constrained

[Model] Add native IFM K2 Horizon serving support (#37654 )

2026-09-03 16:39:43 +08:00

debug_utils

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

disaggregation

[Metrics] Export scheduler stage wall time (#37636 )

2026-09-04 10:45:53 -07:00

distributed

[PD] Bound transfer engine init with SGLANG_DISAGGREGATION_ENGINE_INIT_TIMEOUT (#37874 )

2026-09-03 17:16:55 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

elastic_ep

config: six more runtime readers ask the bags (#36973 )

2026-08-29 04:19:14 -07:00

entrypoints

[feature] Add response-level input/output token ids to chat completions via SglExt (#34488 )

2026-09-04 16:45:13 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

function_call

[Model] Add native IFM K2 Horizon serving support (#37654 )

2026-09-03 16:39:43 +08:00

hardware_backend

[Metrics] Add rolling scheduler utilization counters (#37461 )

2026-09-04 08:06:17 -07:00

kv_canary

[sp] Make attention-TP sequence sharding a per-forward batch property (#37546 )

2026-09-04 02:11:03 -07:00

layers

[GDN] Amortize ReplaySSM checkpoint materialization (#35544 )

2026-09-04 15:13:20 -07:00

lora

[Speculative Decoding] Add native UNO serving support (#37667 )

2026-09-03 20:08:41 +08:00

managers

[feature] Add response-level input/output token ids to chat completions via SglExt (#34488 )

2026-09-04 16:45:13 -07:00

mem_cache

[GDN] Amortize ReplaySSM checkpoint materialization (#35544 )

2026-09-04 15:13:20 -07:00

model_executor

[Fix] Coordinate FullCG prefix variants across DP ranks (#37888 )

2026-09-04 11:29:30 -07:00

model_loader

[model] add cosmos3 reasoner to llm only inference (#33572 )

2026-09-04 22:11:58 +08:00

models

[Performance] Optimize Qwen3.5 GDN prefill projection layouts (#36267 )

2026-09-04 10:32:44 -07:00

multimodal

fix: reformat cosmos3_edge.py to satisfy ruff-format (#38023 )

2026-09-04 23:39:36 +08:00

multiplex

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

observability

[Metrics] Export scheduler stage wall time (#37636 )

2026-09-04 10:45:53 -07:00

parser

[Kimi K3] Rework skipped-think fix as opt-in force_nonempty_content with streaming coverage (#34187 )

2026-09-03 17:37:28 +08:00

platforms

add reindex_device_id to device OOT plugin (#36220 )

2026-09-01 15:26:47 -07:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

ray

config: a parallel size has one spelling; a patched scope declares its own (#36621 )

2026-08-27 12:56:42 -07:00

rust_extensions

[Radix Cache] Add Rust TreeCore backend with shared parity tests (#32710 )

2026-09-01 00:26:20 +08:00

rust_server

[Rust] Bound multimodal media ingress (#37967 )

2026-09-04 05:22:44 -07:00

sampling

[Model] Add native IFM K2 Horizon serving support (#37654 )

2026-09-03 16:39:43 +08:00

session

[HiCache] L3 storage prefetch lifecycle metrics and cross-tier attribution fixes (#37503 )

2026-09-03 16:00:04 -07:00

speculative

[GDN] Amortize ReplaySSM checkpoint materialization (#35544 )

2026-09-04 15:13:20 -07:00

state_capturer

state_capturer: pin the exact host-cache size via mmap + cudaHostRegister (#37285 )

2026-09-03 16:20:59 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

utils

[model] add cosmos3 reasoner to llm only inference (#33572 )

2026-09-04 22:11:58 +08:00

weight_cache

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676 )

2026-08-27 12:16:16 -07:00

environ.py

[Profiler] Add SGLANG_PROFILE_BY_STAGE_DECODE_MIN_BS to defer the decode-stage capture (#38067 )

2026-09-04 15:12:55 -07:00

runtime_context.py

[Feature] Megatron LayerNorm sequence parallelism (--enable-layernorm-sp) (#30915 )

2026-08-31 19:27:28 -07:00

server_args.py

[feature] Add response-level input/output token ids to chat completions via SglExt (#34488 )

2026-09-04 16:45:13 -07:00