fzyzcjy c56cee0f80 Support gated launch to defer startup memory allocation (#35927)

2026-08-24 20:19:45 +08:00

..

arg_groups

[Feature] Add MiniCPM-SALA support (#30360)

2026-08-24 02:25:16 -07:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197)

2026-06-09 09:22:09 +08:00

batch_overlap

[AMD] Support prefill context parallel two batch overlap for DeepSeek V4 (#33480)

2026-08-16 22:40:29 -07:00

checkpoint_engine

…

compilation

[Memory] Borrow CUDA graph pool storage for EAGLE sampling (#35375)

2026-08-18 16:19:41 -07:00

configs

[Feature] Add MiniCPM-SALA support (#30360)

2026-08-24 02:25:16 -07:00

connector

…

constrained

fix(constrained): reject NUL bytes in grammar specs to stop an xgrammar segfault (#34679)

2026-08-19 15:31:14 -07:00

debug_utils

spec: size the speculative buffers from the bags, not the startup record (#35024)

2026-08-17 16:16:56 -07:00

disaggregation

[Feature] Add MiniCPM-SALA support (#30360)

2026-08-24 02:25:16 -07:00

distributed

Support gated launch to defer startup memory allocation (#35927)

2026-08-24 20:19:45 +08:00

dllm

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

elastic_ep

config: project the config bags from the resolution result (#35906)

2026-08-23 01:18:24 -07:00

entrypoints

Report per-token weight-version spans in generation meta info (#35926)

2026-08-24 20:18:52 +08:00

eplb

config: project the config bags from the resolution result (#35906)

2026-08-23 01:18:24 -07:00

function_call

[Fix] lfm2 detector: recover tool calls dropped by common model-outpu… (#34237)

2026-08-23 18:09:43 +08:00

hardware_backend

[bugfix] [NPU] fix transpose batch matmul K*B exceed 65536. (#34715)

2026-08-24 15:22:59 +08:00

kv_canary

config: project the config bags from the resolution result (#35906)

2026-08-23 01:18:24 -07:00

layers

feat(humming): support native W4AFP8 checkpoint schemas (#32033)

2026-08-24 18:59:27 +08:00

lora

config: borrowed-record reads follow the config bags (#35908)

2026-08-23 01:19:20 -07:00

managers

Report per-token weight-version spans in generation meta info (#35926)

2026-08-24 20:18:52 +08:00

mem_cache

[Feature] Add MiniCPM-SALA support (#30360)

2026-08-24 02:25:16 -07:00

model_executor

[Feature] Add MiniCPM-SALA support (#30360)

2026-08-24 02:25:16 -07:00

model_loader

[quantization] share bounded post-load device staging (#35180)

2026-08-24 11:48:30 +08:00

models

[Feature] Add MiniCPM-SALA support (#30360)

2026-08-24 02:25:16 -07:00

multimodal

chore: move cuda_vmm_utils.py under srt/utils/ (#36053)

2026-08-23 21:47:29 -07:00

multiplex

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

observability

config: project the config bags from the resolution result (#35906)

2026-08-23 01:18:24 -07:00

parser

[Model] Complete dots.note.omni support with native encoders, video preprocessing, and MTP decoding (#33829)

2026-08-22 14:19:14 +08:00

platforms

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205)

2026-08-06 08:52:09 +08:00

plugins

…

ray

config: constructing a config no longer resolves it (#35907)

2026-08-23 01:18:53 -07:00

rust_extensions

Build Rust extensions on demand in source checkouts (#34994)

2026-08-16 14:58:06 -07:00

sampling

Add sampling observer auxiliary output hooks (#35747)

2026-08-21 19:28:18 -07:00

session

[Feature] Add MiniCPM-SALA support (#30360)

2026-08-24 02:25:16 -07:00

speculative

config: borrowed-record reads follow the config bags (#35908)

2026-08-23 01:19:20 -07:00

state_capturer

Revert "[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend" (#35568)

2026-08-19 14:14:38 -07:00

tokenizer

Add Inkling model support (#31681)

2026-07-19 22:57:37 -07:00

utils

Report per-token weight-version spans in generation meta info (#35926)

2026-08-24 20:18:52 +08:00

weight_cache

[Weight Cache] Support static DP/EP layouts (#33684)

2026-08-23 19:57:52 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148)

2026-07-14 15:53:33 +08:00

constants.py

…

environ.py

[Feature] Add MiniCPM-SALA support (#30360)

2026-08-24 02:25:16 -07:00

runtime_context.py

fix(xpu): enable compressed-tensors FP8 W8A8 on XPU (RedHatAI FP8-dynamic models) (#33057)

2026-08-24 12:53:48 +08:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094)

2026-06-12 19:27:31 -07:00

server_args.py

Support gated launch to defer startup memory allocation (#35927)

2026-08-24 20:19:45 +08:00