sglang

arg_groups

[unified-memory] Enable prefill cuda-graph capture (#37418 )

2026-09-13 19:17:19 -07:00

batch_invariant_ops

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

batch_overlap

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293 )

2026-09-07 15:39:34 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

checkpoint_engine

[XPU] Make checkpoint_engine worker device-agnostic (#32382 )

2026-09-11 09:56:39 +08:00

compilation

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

configs

[Qwen3.8] Enable NVIDIA NVFP4 on DGX Spark with file-backed PLE and PDL router fix (#39126 )

2026-09-13 16:23:41 +08:00

connector

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

constrained

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

debug_utils

[XPU] Adapt device agnostic API usage (#32093 )

2026-09-11 10:03:12 +08:00

disaggregation

[HiCache][LoRA] Simplify decode offload hash inputs (#39162 )

2026-09-14 11:23:31 +08:00

distributed

config: delete the redundant full stamp in initialize_model_parallel (#39202 )

2026-09-12 17:27:21 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

elastic_ep

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113 )

2026-09-06 21:44:24 -07:00

entrypoints

chore: bump sglang-kernel version to 0.4.7 (#39346 )

2026-09-13 20:49:37 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

function_call

[Fix] Preserve GLM tool argument types across JSON Schema unions (#39136 )

2026-09-13 13:47:13 +08:00

hardware_backend

[NPU] Fix device mismatch in SWA mask for DSpark verify graph capture (#39353 )

2026-09-14 19:36:33 +08:00

kv_canary

Fix KV-canary workspace accounting after graph capture (#38596 )

2026-09-10 16:10:12 -07:00

layers

[misc] Revert #38346 , #33426 , #39061 and #39219 (#39405 )

2026-09-14 03:04:07 -07:00

lora

[LoRA] Support MoE in full and breakable prefill CUDA graphs (#38578 )

2026-09-11 14:40:02 -07:00

managers

[PD] Preserve the prefill rank during rebootstrap (#39357 )

2026-09-14 09:20:37 -07:00

mem_cache

[Fix] Merge adjacent KV-row frees so a mid-page split under DCP cannot double-free (#38941 )

2026-09-14 21:44:32 +08:00

model_executor

[AMD][DSV4] feat: enable fp8 two-pool unified_kv on gfx950 (#37413 )

2026-09-14 02:49:11 -07:00

model_loader

Fix RunAI object-storage checkpoint index filtering (#38988 )

2026-09-12 12:25:57 +08:00

models

[AMD][DSV4] feat: enable fp8 two-pool unified_kv on gfx950 (#37413 )

2026-09-14 02:49:11 -07:00

multimodal

[Perf] Optimize Qwen3-VL unique-image serving on H100 (#36411 )

2026-09-12 15:16:59 +08:00

multiplex

[Scheduler] Unify per-iteration request intake into ingest_requests() (#38389 )

2026-09-07 20:02:02 -07:00

observability

[observability] Fix missing e2e/decode/inference latency span attributes (#37789 )

2026-09-08 22:50:55 +08:00

parser

Add granite_thinking_parser reasoning parser for Granite 4.2 (#38693 )

2026-09-11 07:18:35 -07:00

platforms

[feat] Add base NpuSRTPlatform implementation (#36472 )

2026-09-14 09:32:24 +08:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

ray

[Config] One writer for the declaration stash; no exception to the write seal (#38752 )

2026-09-09 19:22:06 -07:00

rust_extensions

[Rust TreeCore] Harden runtime and CI parity (#37303 )

2026-09-09 10:40:22 +08:00

rust_server

[Rust] Gate health on startup warmup completion (#37994 )

2026-09-09 15:55:13 -07:00

sampling

[Sampling] Support sampling masks with overlap scheduling (#36631 )

2026-09-10 14:52:44 -07:00

session

[Session] Work with PD and Fix empty continuations (#39038 )

2026-09-12 22:24:32 -07:00

speculative

[Unified Cache][7/N] Support MTP, EAGLE, and DSpark draft KV caches in the external linker (#37914 )

2026-09-13 18:22:06 +08:00

state_capturer

state_capturer: pin the exact host-cache size via mmap + cudaHostRegister (#37285 )

2026-09-03 16:20:59 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

utils

[misc] Revert #38346 , #33426 , #39061 and #39219 (#39405 )

2026-09-14 03:04:07 -07:00

weight_cache

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676 )

2026-08-27 12:16:16 -07:00

environ.py

[AMD][DSV4] feat: enable fp8 two-pool unified_kv on gfx950 (#37413 )

2026-09-14 02:49:11 -07:00

runtime_context.py

Add a provider hook for prefill-buffer ceilings (#39182 )

2026-09-12 21:37:10 -07:00

server_args.py

[Perf] Optimize Qwen3-VL unique-image serving on H100 (#36411 )

2026-09-12 15:16:59 +08:00