Mohammad Miadh Angkad 718bd39fe0 [Fix] DP attention: correct the decode->extend prefix off-by-one (#37505)

2026-09-02 16:14:16 -07:00

..

arg_groups

[SM120] DeepSeek-V4: DeepGEMM paged-MQA indexer +FP4 MoE+ page-split (#29927)

2026-09-02 15:49:59 -07:00

batch_invariant_ops

…

batch_overlap

config: a parallel leaf with no live counterpart is read bare (#36620)

2026-08-27 12:56:11 -07:00

beam_search

[mem_cache] Move req_pool_idx into ReqKvInfo (#37094)

2026-08-30 14:46:21 -07:00

checkpoint_engine

…

compilation

[Memory] Borrow CUDA graph pool storage for EAGLE sampling (#35375)

2026-08-18 16:19:41 -07:00

configs

[Fix ] Fix Spark2.5 hybrid SWA config (#37335)

2026-09-01 20:29:09 -07:00

connector

…

constrained

fix(constrained): reject NUL bytes in grammar specs to stop an xgrammar segfault (#34679)

2026-08-19 15:31:14 -07:00

debug_utils

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

disaggregation

fix(disagg): poll receivers during decode preallocation (#37483)

2026-09-02 14:26:40 -07:00

distributed

[Feature] Megatron LayerNorm sequence parallelism (--enable-layernorm-sp) (#30915)

2026-08-31 19:27:28 -07:00

dllm

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

elastic_ep

config: six more runtime readers ask the bags (#36973)

2026-08-29 04:19:14 -07:00

entrypoints

[FlashInfer V0.6.18] feat(dsv4): support --dsa-topk-backend flashinfer with fused top-k (#33237)

2026-09-01 01:18:10 -07:00

eplb

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

function_call

[Fix] Resolve tool argument types through top-level anyOf/oneOf/allOf (#36626)

2026-08-27 21:50:30 -07:00

hardware_backend

[mem_cache] Make release, row-reuse asserts, and presence checks read the KV record (#37167)

2026-08-31 12:46:15 -07:00

kv_canary

config: project the config bags from the resolution result (#35906)

2026-08-23 01:18:24 -07:00

layers

[SM120] DeepSeek-V4: DeepGEMM paged-MQA indexer +FP4 MoE+ page-split (#29927)

2026-09-02 15:49:59 -07:00

lora

[MoE] Add extension points for custom runner backends (#32665)

2026-08-29 19:03:41 -07:00

managers

[Fix] DP attention: correct the decode->extend prefix off-by-one (#37505)

2026-09-02 16:14:16 -07:00

mem_cache

[mem_cache] Make free_swa sync-free on page_size == 1 (#36723)

2026-09-02 14:18:22 -07:00

model_executor

[EAGLE] Prune draft-extend logits to selected rows (#35546)

2026-09-02 15:10:08 -07:00

model_loader

[SM120] DeepSeek-V4: DeepGEMM paged-MQA indexer +FP4 MoE+ page-split (#29927)

2026-09-02 15:49:59 -07:00

models

[SM120] DeepSeek-V4: DeepGEMM paged-MQA indexer +FP4 MoE+ page-split (#29927)

2026-09-02 15:49:59 -07:00

multimodal

[vlm] fix: contain multimodal feature transport failures (#37047)

2026-09-01 13:46:38 +08:00

multiplex

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

observability

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

parser

[Model] Support Ling-3.0-flash (BailingMoeV3) (#33561)

2026-08-26 17:27:23 -07:00

platforms

add reindex_device_id to device OOT plugin (#36220)

2026-09-01 15:26:47 -07:00

plugins

…

ray

config: a parallel size has one spelling; a patched scope declares its own (#36621)

2026-08-27 12:56:42 -07:00

rust_extensions

[Radix Cache] Add Rust TreeCore backend with shared parity tests (#32710)

2026-09-01 00:26:20 +08:00

rust_server

Rust server: align launcher and request validation behavior (#37327)

2026-09-01 23:42:36 -07:00

sampling

fix(frontend): bound stop strings and regex patterns (#37029)

2026-08-29 22:25:26 -07:00

session

[mem_cache] Add free_kv_row to release a request's kv row by row range (#36721)

2026-09-01 01:14:43 -07:00

speculative

[Spec] Publish the final multi-layer EAGLE shared-read event (#36752)

2026-09-02 15:57:50 -07:00

state_capturer

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

tokenizer

Add Inkling model support (#31681)

2026-07-19 22:57:37 -07:00

utils

add reindex_device_id to device OOT plugin (#36220)

2026-09-01 15:26:47 -07:00

weight_cache

weight cache: key daemon paths by GPU UUID (#36101)

2026-08-31 01:44:45 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148)

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676)

2026-08-27 12:16:16 -07:00

environ.py

[Memory] Size the CUDA graph pool from warmup measurements and fix graph-pool borrowing (#36911)

2026-09-01 09:32:38 -07:00

runtime_context.py

[Feature] Megatron LayerNorm sequence parallelism (--enable-layernorm-sp) (#30915)

2026-08-31 19:27:28 -07:00

server_args.py

[MoE] Add FlashInfer SM90 MXFP4 W4A8 CUTLASS MoE (#34967)

2026-08-31 20:04:41 -07:00