Pavan Sivaram GirijalaandYanbingJiang 4dc7dc8518 [Fix] Transformers-fallback (GPT-NeoX) + KV pool config (DeepSeek-VL2) (#35244) ...

Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>

2026-08-31 11:05:50 +08:00

..

arg_groups

feat(unified-memory): dense KV views for uniform-row MHA/SWA models (#34602)

2026-08-30 15:10:12 -07:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197)

2026-06-09 09:22:09 +08:00

batch_overlap

config: a parallel leaf with no live counterpart is read bare (#36620)

2026-08-27 12:56:11 -07:00

beam_search

[mem_cache] Move req_pool_idx into ReqKvInfo (#37094)

2026-08-30 14:46:21 -07:00

checkpoint_engine

…

compilation

[Memory] Borrow CUDA graph pool storage for EAGLE sampling (#35375)

2026-08-18 16:19:41 -07:00

configs

[Fix] Transformers-fallback (GPT-NeoX) + KV pool config (DeepSeek-VL2) (#35244)

2026-08-31 11:05:50 +08:00

connector

…

constrained

fix(constrained): reject NUL bytes in grammar specs to stop an xgrammar segfault (#34679)

2026-08-19 15:31:14 -07:00

debug_utils

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

disaggregation

[PD] Align defensive protocol behavior across Mooncake, NIXL, and Mori (#35281)

2026-08-31 10:57:56 +08:00

distributed

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

dllm

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

elastic_ep

config: six more runtime readers ask the bags (#36973)

2026-08-29 04:19:14 -07:00

entrypoints

[Deps] Bump FlashInfer to 0.6.18 (#36954)

2026-08-30 19:02:39 -07:00

eplb

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

function_call

[Fix] Resolve tool argument types through top-level anyOf/oneOf/allOf (#36626)

2026-08-27 21:50:30 -07:00

hardware_backend

[MLX] Fix startup crash when reporting preloaded weights (#37035)

2026-08-30 17:36:13 -07:00

kv_canary

config: project the config bags from the resolution result (#35906)

2026-08-23 01:18:24 -07:00

layers

[XPU] Use SYCL kernels for topk_transform on XPU (#33318)

2026-08-31 10:33:19 +08:00

lora

[MoE] Add extension points for custom runner backends (#32665)

2026-08-29 19:03:41 -07:00

managers

[mem_cache] Share one ReqKvInfo between a streaming session slot and its request (#37108)

2026-08-30 16:36:48 -07:00

mem_cache

feat(unified-memory): dense KV views for uniform-row MHA/SWA models (#34602)

2026-08-30 15:10:12 -07:00

model_executor

[Config] Round 5.2: the per-model declarations get their own modules (#37087)

2026-08-30 02:24:35 -07:00

model_loader

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

models

[Fix] Transformers-fallback (GPT-NeoX) + KV pool config (DeepSeek-VL2) (#35244)

2026-08-31 11:05:50 +08:00

multimodal

[vlm] fix: preserve per-request vit graph metadata for qwen-vl (#37043)

2026-08-30 21:02:14 +08:00

multiplex

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

observability

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

parser

[Model] Support Ling-3.0-flash (BailingMoeV3) (#33561)

2026-08-26 17:27:23 -07:00

platforms

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205)

2026-08-06 08:52:09 +08:00

plugins

…

ray

config: a parallel size has one spelling; a patched scope declares its own (#36621)

2026-08-27 12:56:42 -07:00

rust_extensions

Build Rust extensions on demand in source checkouts (#34994)

2026-08-16 14:58:06 -07:00

sampling

fix(frontend): bound stop strings and regex patterns (#37029)

2026-08-29 22:25:26 -07:00

session

[mem_cache] Share one ReqKvInfo between a streaming session slot and its request (#37108)

2026-08-30 16:36:48 -07:00

speculative

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

state_capturer

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

tokenizer

Add Inkling model support (#31681)

2026-07-19 22:57:37 -07:00

utils

[Deps] Bump FlashInfer to 0.6.18 (#36954)

2026-08-30 19:02:39 -07:00

weight_cache

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148)

2026-07-14 15:53:33 +08:00

constants.py

Refactor server_args constants and layout (#36676)

2026-08-27 12:16:16 -07:00

environ.py

[Spec] Fix Dspark and Dflash state divergence across TP rank (#33614)

2026-08-29 17:27:43 -07:00

runtime_context.py

[Config] Round 5.2: the per-model declarations get their own modules (#37087)

2026-08-30 02:24:35 -07:00

server_args.py

[Config] Round 5.2: the per-model declarations get their own modules (#37087)

2026-08-30 02:24:35 -07:00