Liangsheng Yin 585c3c6816 [Refactor] Split the FlashInfer autotune dummy-run flag from the LM-head policy (#34336)

2026-08-10 21:20:05 -07:00

..

arg_groups

[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217)

2026-08-09 23:45:11 -07:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197)

2026-06-09 09:22:09 +08:00

batch_overlap

[Refactor] Separate ROCm-specific DeepSeek MHA and MLA forward paths (#31531)

2026-08-08 13:39:36 -07:00

checkpoint_engine

…

compilation

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205)

2026-08-06 08:52:09 +08:00

configs

[BCG][5/N] MLA Fully Support (#33661)

2026-08-09 23:52:14 -07:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995)

2026-05-11 14:20:22 -07:00

constrained

[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217)

2026-08-09 23:45:11 -07:00

debug_utils

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

disaggregation

[EPD] feat: pipeline owner-only multimodal preprocessing (#34206)

2026-08-11 09:08:05 +08:00

distributed

Consolidate CUDA VMM allocation helpers (#34199)

2026-08-10 18:11:11 -07:00

dllm

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

elastic_ep

[Mooncake] Fix ProcessGroup API imports (#32403)

2026-08-03 01:16:41 -07:00

entrypoints

[inkling] Let Anthropic thinking=disabled map to reasoning effort "none" (#33913)

2026-08-08 21:59:32 +08:00

eplb

config: route parallel config-leaf reads through get_parallel() (#33170)

2026-08-01 08:58:39 -07:00

function_call

[Kimi K3] Add reasoning, tool-call, and OpenAI serving support (#33025)

2026-08-01 14:57:23 -07:00

grpc

…

hardware_backend

[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217)

2026-08-09 23:45:11 -07:00

kv_canary

Radix Cache Split: Spin off TreeCore (#29901)

2026-07-25 14:31:59 -07:00

layers

[Refactor] Split the FlashInfer autotune dummy-run flag from the LM-head policy (#34336)

2026-08-10 21:20:05 -07:00

lora

Support Intern-S2-Mobius (#33691)

2026-08-08 11:06:57 +08:00

managers

[PD] Support --enable-unified-memory with PD disaggregation (kimi-linear MLA hybrid-Mamba) (#33362)

2026-08-10 16:07:58 -07:00

mem_cache

Consolidate CUDA VMM allocation helpers (#34199)

2026-08-10 18:11:11 -07:00

model_executor

[Refactor] Split the FlashInfer autotune dummy-run flag from the LM-head policy (#34336)

2026-08-10 21:20:05 -07:00

model_loader

plugins: don't directly set quant class (#34252)

2026-08-10 16:01:31 -07:00

models

[EPD] feat: pipeline owner-only multimodal preprocessing (#34206)

2026-08-11 09:08:05 +08:00

multimodal

[EPD] feat: pipeline owner-only multimodal preprocessing (#34206)

2026-08-11 09:08:05 +08:00

multiplex

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

observability

[Fix] Read trace level via get_global_trace_level() in trace_async (#34325)

2026-08-10 16:46:54 -07:00

parser

[inkling] Render tool-result media instead of coercing content to str (#33898)

2026-08-08 14:39:19 +08:00

platforms

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205)

2026-08-06 08:52:09 +08:00

plugins

…

ray

config: pass the Ray placement group as a launch argument

2026-08-05 19:28:39 -07:00

sampling

Support thinking budget for Inkling (#33146)

2026-08-11 02:01:08 +08:00

session

feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173)

2026-08-02 13:43:55 +08:00

speculative

[Refactor] Split the FlashInfer autotune dummy-run flag from the LM-head policy (#34336)

2026-08-10 21:20:05 -07:00

state_capturer

moe: the shared-experts-fusion decision is a per-runner value the loader installs (#33889)

2026-08-07 22:42:58 -07:00

tokenizer

Add Inkling model support (#31681)

2026-07-19 22:57:37 -07:00

utils

[AMD] Preserve the AITER expert mask across torch_memory_saver pause/resume (#34220)

2026-08-10 19:59:15 -07:00

weight_cache

config: route parallel config-leaf reads through get_parallel() (#33170)

2026-08-01 08:58:39 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148)

2026-07-14 15:53:33 +08:00

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005)

2026-06-03 12:55:24 -07:00

cuda_vmm_utils.py

Consolidate CUDA VMM allocation helpers (#34199)

2026-08-10 18:11:11 -07:00

environ.py

[CI] Add MegaMoE runner compatibility alias (#34326)

2026-08-10 19:47:38 -07:00

runtime_context.py

config: the KV-cache configurator reads the bags (#34096)

2026-08-09 14:45:42 -07:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094)

2026-06-12 19:27:31 -07:00

server_args.py

[CI] Add MegaMoE runner compatibility alias (#34326)

2026-08-10 19:47:38 -07:00