sglang

arg_groups

[PP][DeepSeek V4] Overlap communication and optimize SM120 prefill (#38792 )

2026-09-18 21:18:04 -07:00

batch_invariant_ops

Add Ling-3.0-flash-VL model support (#38526 )

2026-09-17 00:19:26 +08:00

batch_overlap

[Runtime] Add decode CUDA graph hooks for eager logits processing (#40222 )

2026-09-18 23:27:03 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

checkpoint_engine

[XPU] Make checkpoint_engine worker device-agnostic (#32382 )

2026-09-11 09:56:39 +08:00

compilation

[SRT] Clean up no-op compiler pass, dead helpers, and migration tests (#39295 )

2026-09-16 12:04:21 +08:00

configs

Support MXFP8 and deferred route weighting in DeepEP v2 (#40030 )

2026-09-18 15:40:38 -07:00

connector

[NPU] Support nccl backend for --remote-instance-weight-loader (#39413 )

2026-09-17 17:28:15 +08:00

constrained

[Fix] Allow closed object schemas in Outlines prevalidation (#39869 )

2026-09-16 16:42:17 -07:00

debug_utils

Give the attention-DP width and rank one home (#40067 )

2026-09-18 17:34:33 -07:00

disaggregation

Fix prefetch attempt cleanup on abort (#40262 )

2026-09-18 22:46:17 -07:00

distributed

One read path for every parallel name (#40069 )

2026-09-18 17:43:56 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

elastic_ep

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

entrypoints

fix(openai): recover logprobs token bytes from token_id (UTF-8 fragments) (#38604 )

2026-09-18 20:30:04 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

function_call

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

hardware_backend

[Metrics] Propagate idle gaps across all scheduler loops (#40004 )

2026-09-18 22:42:00 -07:00

kv_canary

Fix KV-canary workspace accounting after graph capture (#38596 )

2026-09-10 16:10:12 -07:00

layers

[Lint] Fix logits processor formatting on main (#40303 )

2026-09-19 14:31:56 +08:00

lora

[Refactor] Deduplicate kernel helpers and remove unused code (#40197 )

2026-09-19 09:27:30 +08:00

managers

[Metrics] Propagate idle gaps across all scheduler loops (#40004 )

2026-09-18 22:42:00 -07:00

mem_cache

[HiCache] Size MHA host pools from device row width (#40304 )

2026-09-18 23:37:58 -07:00

model_executor

[Runtime] Add decode CUDA graph hooks for eager logits processing (#40222 )

2026-09-18 23:27:03 -07:00

model_loader

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

models

[PP][DeepSeek V4] Overlap communication and optimize SM120 prefill (#38792 )

2026-09-18 21:18:04 -07:00

multimodal

[VLM] avoid CUDA placement on non-CUDA platforms (#38750 )

2026-09-19 11:13:22 +08:00

multiplex

[Metrics] Propagate idle gaps across all scheduler loops (#40004 )

2026-09-18 22:42:00 -07:00

observability

[PD] Introduce runtime role switching between prefill and decode (#28403 )

2026-09-18 01:45:12 +08:00

parser

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

platforms

[Runtime] Let out-of-tree platforms provide full graph backends (#37969 )

2026-09-18 15:42:46 +08:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

ray

[Config] One writer for the declaration stash; no exception to the write seal (#38752 )

2026-09-09 19:22:06 -07:00

rust_extensions

[Rust TreeCore] Harden runtime and CI parity (#37303 )

2026-09-09 10:40:22 +08:00

rust_server

Add external multimodal processors to the Rust frontend (#39329 )

2026-09-15 15:38:47 -07:00

sampling

perf(sampling): avoid GPU syncs when applying custom logit processors (#39234 )

2026-09-18 17:09:30 -07:00

session

[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050 )

2026-09-17 17:53:58 +08:00

speculative

Fix GLM-OCR MTP multimodal embeddings and positions (#39088 )

2026-09-18 21:10:04 -07:00

state_capturer

Use a shared byte budget for unified hybrid-SWA memory (#36729 )

2026-09-15 15:27:00 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

utils

fix: restrict SafeUnpickler to explicit globals (#40259 )

2026-09-18 22:38:11 -07:00

weight_cache

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676 )

2026-08-27 12:16:16 -07:00

environ.py

[PP][DeepSeek V4] Overlap communication and optimize SM120 prefill (#38792 )

2026-09-18 21:18:04 -07:00

runtime_context.py

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

server_args.py

Support unified memory page-envelope transfers in PD (#39477 )

2026-09-18 17:39:50 -07:00