6 people 295132c4a5 [NPU] Add sparsity-driven KV offload for DeepSeek DSA on Ascend (#33089) ...

Co-authored-by: itcj <itcj@foxmail.com>
Co-authored-by: chenyh <chenyh18@mail.ustc.edu.cn>
Co-authored-by: hibikid <7514545+hibikid@user.noreply.gitee.com>
Co-authored-by: Chengjie Tang <tangcj@sxu.edu.cn>
Co-authored-by: wangbiao0814 <wangbiao0814@outlook.com>

2026-09-09 09:13:22 +08:00

..

arg_groups

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00

batch_invariant_ops

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

batch_overlap

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293)

2026-09-07 15:39:34 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

checkpoint_engine

…

compilation

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

configs

support qwen 3.8 flash next (#37500)

2026-09-08 13:56:21 -07:00

connector

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

constrained

[Config] Round 6.4: the runtime reads the bags, not the record (#38049)

2026-09-06 21:41:46 -07:00

debug_utils

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

disaggregation

support qwen 3.8 flash next (#37500)

2026-09-08 13:56:21 -07:00

distributed

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293)

2026-09-07 15:39:34 -07:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

elastic_ep

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113)

2026-09-06 21:44:24 -07:00

entrypoints

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113)

2026-09-06 21:44:24 -07:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

function_call

[Model] Add support for Nanbeige4.2 (#32151)

2026-09-06 03:57:27 +08:00

hardware_backend

[NPU] Add sparsity-driven KV offload for DeepSeek DSA on Ascend (#33089)

2026-09-09 09:13:22 +08:00

kv_canary

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00

layers

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00

lora

[Intel][XPU][LoRA] Enable LoRA on Intel XPU (#30345)

2026-09-08 12:46:41 +08:00

managers

Revert "PD disaggregation, isolated transfer, prefill OOM fixed." (#38572)

2026-09-08 15:57:44 -07:00

mem_cache

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00

model_executor

[NPU] Add sparsity-driven KV offload for DeepSeek DSA on Ascend (#33089)

2026-09-09 09:13:22 +08:00

model_loader

GLM-5.3-Flash support (#36507)

2026-09-06 02:27:59 -07:00

models

MiniMax-M3: Triton split-K router GEMV with in-kernel fixup (#36557)

2026-09-08 16:39:41 -07:00

multimodal

support qwen 3.8 flash next (#37500)

2026-09-08 13:56:21 -07:00

multiplex

[Scheduler] Unify per-iteration request intake into ingest_requests() (#38389)

2026-09-07 20:02:02 -07:00

observability

[observability] Fix missing e2e/decode/inference latency span attributes (#37789)

2026-09-08 22:50:55 +08:00

parser

[Kimi-K3] Recover the reply when the model skips the think channel (#37743)

2026-09-07 14:08:42 +00:00

platforms

add reindex_device_id to device OOT plugin (#36220)

2026-09-01 15:26:47 -07:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

ray

[ray] Support Ray metric backend for engine metrics (#31415)

2026-09-07 12:43:19 -07:00

rust_extensions

[CI] Pin the Rust TreeCore build to the resolved libtorch instead of interpreter discovery (#37696)

2026-09-05 15:30:32 -07:00

rust_server

[rust-server] fix p/d bootstrap across dp listeners (#36234)

2026-09-08 13:22:32 +08:00

sampling

[Sampling] Allow sampling-mask replay with DisallowedTokensLogitsProcessor (#38279)

2026-09-06 23:56:16 -07:00

session

[Unified Tree] Support Branching-Point Caching for the SWA Component (#34565)

2026-09-05 12:29:16 +08:00

speculative

support qwen 3.8 flash next (#37500)

2026-09-08 13:56:21 -07:00

state_capturer

state_capturer: pin the exact host-cache size via mmap + cudaHostRegister (#37285)

2026-09-03 16:20:59 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

utils

support qwen 3.8 flash next (#37500)

2026-09-08 13:56:21 -07:00

weight_cache

[Config] Round 6.4: the runtime reads the bags, not the record (#38049)

2026-09-06 21:41:46 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148)

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676)

2026-08-27 12:16:16 -07:00

environ.py

[NPU] Add sparsity-driven KV offload for DeepSeek DSA on Ascend (#33089)

2026-09-09 09:13:22 +08:00

runtime_context.py

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00

server_args.py

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00