sglang

arg_groups

[HiCache] Auto-size the host pool to fit available host memory (#40135 )

2026-09-19 12:50:43 -07:00

batch_invariant_ops

Add Ling-3.0-flash-VL model support (#38526 )

2026-09-17 00:19:26 +08:00

batch_overlap

[Runtime] Add decode CUDA graph hooks for eager logits processing (#40222 )

2026-09-18 23:27:03 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

checkpoint_engine

[XPU] Make checkpoint_engine worker device-agnostic (#32382 )

2026-09-11 09:56:39 +08:00

compilation

[SRT] Clean up no-op compiler pass, dead helpers, and migration tests (#39295 )

2026-09-16 12:04:21 +08:00

configs

Support MXFP8 and deferred route weighting in DeepEP v2 (#40030 )

2026-09-18 15:40:38 -07:00

connector

[NPU] Support nccl backend for --remote-instance-weight-loader (#39413 )

2026-09-17 17:28:15 +08:00

constrained

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

debug_utils

Give the attention-DP width and rank one home (#40067 )

2026-09-18 17:34:33 -07:00

disaggregation

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

distributed

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

elastic_ep

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

entrypoints

fix(openai): recover logprobs token bytes from token_id (UTF-8 fragments) (#38604 )

2026-09-18 20:30:04 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

function_call

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

hardware_backend

[Metrics] Propagate idle gaps across all scheduler loops (#40004 )

2026-09-18 22:42:00 -07:00

kv_canary

Fix KV-canary workspace accounting after graph capture (#38596 )

2026-09-10 16:10:12 -07:00

layers

[AMD][DSV4] fix: skip compressed-KV metadata on the draft worker in the HIP radix backend (#40205 )

2026-09-19 12:13:49 -07:00

lora

[Refactor] Deduplicate kernel helpers and remove unused code (#40197 )

2026-09-19 09:27:30 +08:00

managers

[Logprob] Serve input-logprob temporaries from CUDA-graph-pool dead space (#40038 )

2026-09-19 12:03:52 -07:00

mem_cache

[HiCache] Auto-size the host pool to fit available host memory (#40135 )

2026-09-19 12:50:43 -07:00

model_executor

[Logprob] Serve input-logprob temporaries from CUDA-graph-pool dead space (#40038 )

2026-09-19 12:03:52 -07:00

model_loader

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

models

[Fix] Keep mHC context out of non-V4 compiled MoE forwards (#40353 )

2026-09-19 21:41:51 +08:00

multimodal

[VLM] avoid CUDA placement on non-CUDA platforms (#38750 )

2026-09-19 11:13:22 +08:00

multiplex

[Metrics] Propagate idle gaps across all scheduler loops (#40004 )

2026-09-18 22:42:00 -07:00

observability

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

parser

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

platforms

[Runtime] Let out-of-tree platforms provide full graph backends (#37969 )

2026-09-18 15:42:46 +08:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

ray

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

rust_extensions

[Rust TreeCore] Harden runtime and CI parity (#37303 )

2026-09-09 10:40:22 +08:00

rust_server

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

sampling

perf(sampling): avoid GPU syncs when applying custom logit processors (#39234 )

2026-09-18 17:09:30 -07:00

session

[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050 )

2026-09-17 17:53:58 +08:00

speculative

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

state_capturer

Use a shared byte budget for unified hybrid-SWA memory (#36729 )

2026-09-15 15:27:00 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

utils

[Logprob] Serve input-logprob temporaries from CUDA-graph-pool dead space (#40038 )

2026-09-19 12:03:52 -07:00

weight_cache

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676 )

2026-08-27 12:16:16 -07:00

environ.py

[DSV4.1] Big fused wo_a quant (#39957 )

2026-09-19 19:46:53 +08:00

runtime_context.py

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

server_args.py

Support unified memory page-envelope transfers in PD (#39477 )

2026-09-18 17:39:50 -07:00