James 165d8dd177 [NPU][Hicache] Add Ascend Memcache Hicache L3 storage backend (#38827)

2026-09-11 18:54:00 +08:00

..

arg_groups

[NPU][Hicache] Add Ascend Memcache Hicache L3 storage backend (#38827)

2026-09-11 18:54:00 +08:00

batch_invariant_ops

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

batch_overlap

[CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293)

2026-09-07 15:39:34 -07:00

beam_search

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

checkpoint_engine

[XPU] Make checkpoint_engine worker device-agnostic (#32382)

2026-09-11 09:56:39 +08:00

compilation

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

configs

Support NemotronH_Omni_Reasoning_V3 in SGLang (#35599)

2026-09-10 16:57:22 -07:00

connector

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

constrained

[Config] Round 6.4: the runtime reads the bags, not the record (#38049)

2026-09-06 21:41:46 -07:00

debug_utils

[XPU] Adapt device agnostic API usage (#32093)

2026-09-11 10:03:12 +08:00

disaggregation

[Refactor] Clarify DeepSeek V4 metadata names for V4.1 (#38947)

2026-09-10 15:42:52 -07:00

distributed

[NPU] fix pp 2 hang on npu (#38249)

2026-09-10 19:21:37 +08:00

dllm

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

elastic_ep

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113)

2026-09-06 21:44:24 -07:00

entrypoints

[Responses] Fix empty-prompt routing for token-first chat encoders (kimi_k3, inkling) (#35486)

2026-09-11 01:06:20 +00:00

eplb

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

function_call

[Model] Add support for Nanbeige4.2 (#32151)

2026-09-06 03:57:27 +08:00

hardware_backend

[NPU]glm5.2 fp8 memory opt (#38807)

2026-09-11 18:48:45 +08:00

kv_canary

Fix KV-canary workspace accounting after graph capture (#38596)

2026-09-10 16:10:12 -07:00

layers

[Refactor] Generalize attention graph variants in the decode runner (#38993)

2026-09-11 00:45:58 -07:00

lora

[Intel][XPU][LoRA] Enable LoRA on Intel XPU (#30345)

2026-09-08 12:46:41 +08:00

managers

[NPU][Hicache] Add Ascend Memcache Hicache L3 storage backend (#38827)

2026-09-11 18:54:00 +08:00

mem_cache

[NPU][Hicache] Add Ascend Memcache Hicache L3 storage backend (#38827)

2026-09-11 18:54:00 +08:00

model_executor

[Refactor] Generalize attention graph variants in the decode runner (#38993)

2026-09-11 00:45:58 -07:00

model_loader

[AMD] Quantize the bf16 MTP draft experts online to MXFP4 for Qwen3.5 (#38748)

2026-09-10 13:00:41 -07:00

models

[AMD] Fix DeepSeek block-FP8 loading on gfx94x (#38446)

2026-09-10 23:00:29 -07:00

multimodal

Support NemotronH_Omni_Reasoning_V3 in SGLang (#35599)

2026-09-10 16:57:22 -07:00

multiplex

[Scheduler] Unify per-iteration request intake into ingest_requests() (#38389)

2026-09-07 20:02:02 -07:00

observability

[observability] Fix missing e2e/decode/inference latency span attributes (#37789)

2026-09-08 22:50:55 +08:00

parser

[Config] One writer for the declaration stash; no exception to the write seal (#38752)

2026-09-09 19:22:06 -07:00

platforms

add reindex_device_id to device OOT plugin (#36220)

2026-09-01 15:26:47 -07:00

plugins

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

ray

[Config] One writer for the declaration stash; no exception to the write seal (#38752)

2026-09-09 19:22:06 -07:00

rust_extensions

[Rust TreeCore] Harden runtime and CI parity (#37303)

2026-09-09 10:40:22 +08:00

rust_server

[Rust] Gate health on startup warmup completion (#37994)

2026-09-09 15:55:13 -07:00

sampling

[Sampling] Support sampling masks with overlap scheduling (#36631)

2026-09-10 14:52:44 -07:00

session

[HiCache] Replace skip_lock_node_ids with a segment lock protocol (#36848)

2026-09-09 14:55:51 -07:00

speculative

[Refactor] Generalize attention graph variants in the decode runner (#38993)

2026-09-11 00:45:58 -07:00

state_capturer

state_capturer: pin the exact host-cache size via mmap + cudaHostRegister (#37285)

2026-09-03 16:20:59 -07:00

tokenizer

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

utils

Support NemotronH_Omni_Reasoning_V3 in SGLang (#35599)

2026-09-10 16:57:22 -07:00

weight_cache

[Config] Round 6.4: the runtime reads the bags, not the record (#38049)

2026-09-06 21:41:46 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148)

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676)

2026-08-27 12:16:16 -07:00

environ.py

[NPU][Hicache] Add Ascend Memcache Hicache L3 storage backend (#38827)

2026-09-11 18:54:00 +08:00

runtime_context.py

[NVIDIA] Support flashinfer Mega Moe (#31470)

2026-09-10 00:22:47 -07:00

server_args.py

[Config] msgspec.Struct for the config tier (#38753)

2026-09-09 19:41:19 -07:00