sglang

arg_groups

【NPU】Support EAGLE when PP enabled in prefill nodes (#32207 )

2026-09-08 15:45:36 +08:00

batch_invariant_ops

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

batch_overlap

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293 )

2026-09-07 15:39:34 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

checkpoint_engine

…

compilation

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

configs

[AMD][GLM-5.2] Keep GlmMoeDsa MoE e_score_correction_bias in fp32 (#37133 )

2026-09-07 18:17:54 -07:00

connector

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

constrained

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

debug_utils

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

disaggregation

【NPU】Support EAGLE when PP enabled in prefill nodes (#32207 )

2026-09-08 15:45:36 +08:00

distributed

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293 )

2026-09-07 15:39:34 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

elastic_ep

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113 )

2026-09-06 21:44:24 -07:00

entrypoints

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113 )

2026-09-06 21:44:24 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

function_call

[Model] Add support for Nanbeige4.2 (#32151 )

2026-09-06 03:57:27 +08:00

hardware_backend

【NPU】Support EAGLE when PP enabled in prefill nodes (#32207 )

2026-09-08 15:45:36 +08:00

kv_canary

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

layers

[AMD] Skip AITER FP8 ASM prefill when GQA is unsupported (#38467 )

2026-09-08 02:49:47 -07:00

lora

[Intel][XPU][LoRA] Enable LoRA on Intel XPU (#30345 )

2026-09-08 12:46:41 +08:00

managers

【NPU】Support EAGLE when PP enabled in prefill nodes (#32207 )

2026-09-08 15:45:36 +08:00

mem_cache

Fix DSA compression tail capacity for PD decode request slots (#38417 )

2026-09-08 01:50:07 -07:00

model_executor

【NPU】Support EAGLE when PP enabled in prefill nodes (#32207 )

2026-09-08 15:45:36 +08:00

model_loader

GLM-5.3-Flash support (#36507 )

2026-09-06 02:27:59 -07:00

models

【NPU】Support EAGLE when PP enabled in prefill nodes (#32207 )

2026-09-08 15:45:36 +08:00

multimodal

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

multiplex

[Scheduler] Unify per-iteration request intake into ingest_requests() (#38389 )

2026-09-07 20:02:02 -07:00

observability

[ray] Support Ray metric backend for engine metrics (#31415 )

2026-09-07 12:43:19 -07:00

parser

[Kimi-K3] Recover the reply when the model skips the think channel (#37743 )

2026-09-07 14:08:42 +00:00

platforms

add reindex_device_id to device OOT plugin (#36220 )

2026-09-01 15:26:47 -07:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

ray

[ray] Support Ray metric backend for engine metrics (#31415 )

2026-09-07 12:43:19 -07:00

rust_extensions

[CI] Pin the Rust TreeCore build to the resolved libtorch instead of interpreter discovery (#37696 )

2026-09-05 15:30:32 -07:00

rust_server

[rust-server] fix p/d bootstrap across dp listeners (#36234 )

2026-09-08 13:22:32 +08:00

sampling

[Sampling] Allow sampling-mask replay with DisallowedTokensLogitsProcessor (#38279 )

2026-09-06 23:56:16 -07:00

session

[Unified Tree] Support Branching-Point Caching for the SWA Component (#34565 )

2026-09-05 12:29:16 +08:00

speculative

【NPU】Support EAGLE when PP enabled in prefill nodes (#32207 )

2026-09-08 15:45:36 +08:00

state_capturer

state_capturer: pin the exact host-cache size via mmap + cudaHostRegister (#37285 )

2026-09-03 16:20:59 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

utils

[Feature][Intel XPU] Add memory saver support for Intel XPU via upstream torch_memory_saver (#29935 )

2026-09-08 09:38:51 +08:00

weight_cache

[Config] Round 6.4: the runtime reads the bags, not the record (#38049 )

2026-09-06 21:41:46 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676 )

2026-08-27 12:16:16 -07:00

environ.py

[Kernel] Drop the vendored dense BF16 GEMM port in favor of FlashInfer 0.6.18 (#38124 )

2026-09-07 12:59:33 -07:00

runtime_context.py

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113 )

2026-09-06 21:44:24 -07:00

server_args.py

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293 )

2026-09-07 15:39:34 -07:00