sglang

arg_groups

Enable optimistic prefill for Mamba radix-cache models (#40184 )

2026-09-19 19:28:11 -07:00

batch_invariant_ops

Add Ling-3.0-flash-VL model support (#38526 )

2026-09-17 00:19:26 +08:00

batch_overlap

[Runtime] Add decode CUDA graph hooks for eager logits processing (#40222 )

2026-09-18 23:27:03 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

checkpoint_engine

[XPU] Make checkpoint_engine worker device-agnostic (#32382 )

2026-09-11 09:56:39 +08:00

compilation

[SRT] Clean up no-op compiler pass, dead helpers, and migration tests (#39295 )

2026-09-16 12:04:21 +08:00

configs

[MegaMoE] Wire Qwen MoE blocks to DeepGEMM MegaMoE (MXFP4 and NVFP4 experts) (#38080 )

2026-09-19 16:00:38 -07:00

connector

[NPU] Support nccl backend for --remote-instance-weight-loader (#39413 )

2026-09-17 17:28:15 +08:00

constrained

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

debug_utils

Give the attention-DP width and rank one home (#40067 )

2026-09-18 17:34:33 -07:00

disaggregation

[PD] Enter the custom mem pool once when allocating DCP pack buffers (#40284 )

2026-09-19 19:34:58 -07:00

distributed

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

elastic_ep

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

entrypoints

fix(openai): recover logprobs token bytes from token_id (UTF-8 fragments) (#38604 )

2026-09-18 20:30:04 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

function_call

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

hardware_backend

[NPU][DSV4]dsv4 enable cpp (#39820 )

2026-09-20 09:17:27 +08:00

kv_canary

Fix KV-canary workspace accounting after graph capture (#38596 )

2026-09-10 16:10:12 -07:00

layers

[NPU][bugfix] update low latency quantization input and update MXFP8 tests (#38831 )

2026-09-20 09:55:30 +08:00

lora

[Refactor] Deduplicate kernel helpers and remove unused code (#40197 )

2026-09-19 09:27:30 +08:00

managers

[PP + HiCache] Add PP Prefetch Tickets for eager cross-stage storage prefetch (#36700 )

2026-09-20 11:19:31 +08:00

mem_cache

[2/N] [Kernel] Fuse padding-preserving HiSparse slot translation (#39837 )

2026-09-20 12:04:03 +08:00

model_executor

Fix disagg PP MTP for GLM-5.2 (#39378 )

2026-09-19 13:55:07 -07:00

model_loader

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

models

[2/N] [Kernel] Fuse padding-preserving HiSparse slot translation (#39837 )

2026-09-20 12:04:03 +08:00

multimodal

[VLM] avoid CUDA placement on non-CUDA platforms (#38750 )

2026-09-19 11:13:22 +08:00

multiplex

[Metrics] Propagate idle gaps across all scheduler loops (#40004 )

2026-09-18 22:42:00 -07:00

observability

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

parser

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

platforms

[Runtime] Let out-of-tree platforms provide full graph backends (#37969 )

2026-09-18 15:42:46 +08:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

ray

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

rust_extensions

[Rust TreeCore] Harden runtime and CI parity (#37303 )

2026-09-09 10:40:22 +08:00

rust_server

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

sampling

perf(sampling): avoid GPU syncs when applying custom logit processors (#39234 )

2026-09-18 17:09:30 -07:00

session

[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050 )

2026-09-17 17:53:58 +08:00

speculative

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

state_capturer

Use a shared byte budget for unified hybrid-SWA memory (#36729 )

2026-09-15 15:27:00 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

utils

[Logprob] Serve input-logprob temporaries from CUDA-graph-pool dead space (#40038 )

2026-09-19 12:03:52 -07:00

weight_cache

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676 )

2026-08-27 12:16:16 -07:00

environ.py

[DSV4.1] Big fused wo_a quant (#39957 )

2026-09-19 19:46:53 +08:00

runtime_context.py

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

server_args.py

Support unified memory page-envelope transfers in PD (#39477 )

2026-09-18 17:39:50 -07:00