sglang

arg_groups

dsv4(npu): support prefill context parallelism with interleave and zigzag (#39427 )

2026-09-17 19:59:41 +08:00

batch_invariant_ops

Add Ling-3.0-flash-VL model support (#38526 )

2026-09-17 00:19:26 +08:00

batch_overlap

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293 )

2026-09-07 15:39:34 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

checkpoint_engine

[XPU] Make checkpoint_engine worker device-agnostic (#32382 )

2026-09-11 09:56:39 +08:00

compilation

[SRT] Clean up no-op compiler pass, dead helpers, and migration tests (#39295 )

2026-09-16 12:04:21 +08:00

configs

dsv4.1: Engram module and request history support (#39666 )

2026-09-16 23:49:47 -07:00

connector

[NPU] Support nccl backend for --remote-instance-weight-loader (#39413 )

2026-09-17 17:28:15 +08:00

constrained

[Fix] Allow closed object schemas in Outlines prevalidation (#39869 )

2026-09-16 16:42:17 -07:00

debug_utils

[XPU] Adapt device agnostic API usage (#32093 )

2026-09-11 10:03:12 +08:00

disaggregation

[PD] Add optional KV transfer checksums (#39500 )

2026-09-16 23:53:30 +08:00

distributed

dsv4.1: communication kernels and wrappers (#39653 )

2026-09-16 02:09:40 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

elastic_ep

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113 )

2026-09-06 21:44:24 -07:00

entrypoints

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

function_call

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

hardware_backend

dsv4(npu): support prefill context parallelism with interleave and zigzag (#39427 )

2026-09-17 19:59:41 +08:00

kv_canary

Fix KV-canary workspace accounting after graph capture (#38596 )

2026-09-10 16:10:12 -07:00

layers

[DP Attn] Fix crash for no token all-gather case (#39899 )

2026-09-17 09:21:09 -07:00

lora

[LoRA] Support MoE in full and breakable prefill CUDA graphs (#38578 )

2026-09-11 14:40:02 -07:00

managers

[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050 )

2026-09-17 17:53:58 +08:00

mem_cache

[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050 )

2026-09-17 17:53:58 +08:00

model_executor

[NPU] Support nccl backend for --remote-instance-weight-loader (#39413 )

2026-09-17 17:28:15 +08:00

model_loader

[SRT] Clean up no-op compiler pass, dead helpers, and migration tests (#39295 )

2026-09-16 12:04:21 +08:00

models

dsv4(npu): support prefill context parallelism with interleave and zigzag (#39427 )

2026-09-17 19:59:41 +08:00

multimodal

fix(multimodal): handle tensor images in exact-token preprocessing (#30368 )

2026-09-17 09:20:21 -07:00

multiplex

[Scheduler] Unify per-iteration request intake into ingest_requests() (#38389 )

2026-09-07 20:02:02 -07:00

observability

feat: support custom OTLP trace service name (#35802 )

2026-09-16 22:37:42 +08:00

parser

dsv4.1: chat encoding and tool parsing (#39665 )

2026-09-16 20:49:42 -07:00

platforms

[NPU][Bugfix] Disable pinned memory to fix DeepSeek-V2 DP-attention hang (#39423 )

2026-09-15 14:59:31 +08:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

ray

[Config] One writer for the declaration stash; no exception to the write seal (#38752 )

2026-09-09 19:22:06 -07:00

rust_extensions

[Rust TreeCore] Harden runtime and CI parity (#37303 )

2026-09-09 10:40:22 +08:00

rust_server

Add external multimodal processors to the Rust frontend (#39329 )

2026-09-15 15:38:47 -07:00

sampling

[NPU] Avoid device synchronization in Ascend sampling (#39404 )

2026-09-16 10:15:16 +03:00

session

[HiCache][Perf] fix: batch HiCache D2H submits per step for hybrid pools (#39050 )

2026-09-17 17:53:58 +08:00

speculative

Pipeline parallelism x speculative decoding (EAGLE/MTP) compatibility (#30775 )

2026-09-16 21:41:54 -07:00

state_capturer

Use a shared byte budget for unified hybrid-SWA memory (#36729 )

2026-09-15 15:27:00 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

utils

Restrict SafeUnpickler standard-library globals (#39858 )

2026-09-17 01:09:55 -07:00

weight_cache

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676 )

2026-08-27 12:16:16 -07:00

environ.py

dsv4.1: Engram module and request history support (#39666 )

2026-09-16 23:49:47 -07:00

runtime_context.py

Add a provider hook for prefill-buffer ceilings (#39182 )

2026-09-12 21:37:10 -07:00

server_args.py

[Perf] Optimize Qwen3-VL unique-image serving on H100 (#36411 )

2026-09-12 15:16:59 +08:00