sglang

arg_groups

Remove swa and mamba radix cache (#40313 )

2026-09-20 16:16:27 +08:00

batch_invariant_ops

Add Ling-3.0-flash-VL model support (#38526 )

2026-09-17 00:19:26 +08:00

batch_overlap

[GLM-5.3-Flash] Reduce KPool planning synchronization and overlap indexer preparation (#39695 )

2026-09-19 23:51:17 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

checkpoint_engine

[XPU] Make checkpoint_engine worker device-agnostic (#32382 )

2026-09-11 09:56:39 +08:00

compilation

[SRT] Clean up no-op compiler pass, dead helpers, and migration tests (#39295 )

2026-09-16 12:04:21 +08:00

configs

[Model] Serve DeepSeek-OCR-2 with its official 768px local-crop geometry (#38996 )

2026-09-20 14:17:21 +08:00

connector

[NPU] Support nccl backend for --remote-instance-weight-loader (#39413 )

2026-09-17 17:28:15 +08:00

constrained

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

debug_utils

Give the attention-DP width and rank one home (#40067 )

2026-09-18 17:34:33 -07:00

disaggregation

[PD] Bound cached-prefix DCP transfers by pack capacity (#40376 )

2026-09-21 01:17:15 +08:00

distributed

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

elastic_ep

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

entrypoints

fix(openai): recover logprobs token bytes from token_id (UTF-8 fragments) (#38604 )

2026-09-18 20:30:04 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

function_call

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

hardware_backend

[NPU][DSV4]dsv4 enable cpp (#39820 )

2026-09-20 09:17:27 +08:00

kv_canary

Remove swa and mamba radix cache (#40313 )

2026-09-20 16:16:27 +08:00

layers

[Diffusion] Enable shared RMSNorm dispatch for SenseNova-U1 (#39705 )

2026-09-20 17:08:02 +03:00

lora

[Refactor] Deduplicate kernel helpers and remove unused code (#40197 )

2026-09-19 09:27:30 +08:00

managers

[HiCache] Fix sparse hybrid transfer layer IDs (#37870 )

2026-09-20 16:24:24 +08:00

mem_cache

[HiCache] Fix sparse hybrid transfer layer IDs (#37870 )

2026-09-20 16:24:24 +08:00

model_executor

[Fix] Preserve model runner contracts in prefill CUDA graphs (#35452 )

2026-09-20 13:53:14 -07:00

model_loader

Name the two widths of the WORLD group (#40070 )

2026-09-18 17:47:02 -07:00

models

[Qwen4-Exp] Build the offloaded PLE table on the meta device so --ple-offload-embedding never materialises it on the accelerator (#39928 )

2026-09-20 08:28:25 -07:00

multimodal

[Model] Serve DeepSeek-OCR-2 with its official 768px local-crop geometry (#38996 )

2026-09-20 14:17:21 +08:00

multiplex

[Metrics] Propagate idle gaps across all scheduler loops (#40004 )

2026-09-18 22:42:00 -07:00

observability

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

parser

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

platforms

Add out-of-tree DFlash extension points (#38740 )

2026-09-20 14:54:46 +08:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

ray

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

rust_extensions

[Rust TreeCore] Harden runtime and CI parity (#37303 )

2026-09-09 10:40:22 +08:00

rust_server

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

sampling

perf(sampling): avoid GPU syncs when applying custom logit processors (#39234 )

2026-09-18 17:09:30 -07:00

session

[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050 )

2026-09-17 17:53:58 +08:00

speculative

[kimi k3][pd disagg] support pp prefill + dcp decode with dspark (#40045 )

2026-09-20 00:15:28 -07:00

state_capturer

Use a shared byte budget for unified hybrid-SWA memory (#36729 )

2026-09-15 15:27:00 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

utils

Remove swa and mamba radix cache (#40313 )

2026-09-20 16:16:27 +08:00

weight_cache

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676 )

2026-08-27 12:16:16 -07:00

environ.py

Remove swa and mamba radix cache (#40313 )

2026-09-20 16:16:27 +08:00

runtime_context.py

Record a process's placement at publish, not at group build (#40071 )

2026-09-18 23:52:37 -07:00

server_args.py

Support unified memory page-envelope transfers in PD (#39477 )

2026-09-18 17:39:50 -07:00