sglang

arg_groups

[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217 )

2026-08-09 23:45:11 -07:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197 )

2026-06-09 09:22:09 +08:00

batch_overlap

[Refactor] Separate ROCm-specific DeepSeek MHA and MLA forward paths (#31531 )

2026-08-08 13:39:36 -07:00

checkpoint_engine

…

compilation

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

configs

[BCG][5/N] MLA Fully Support (#33661 )

2026-08-09 23:52:14 -07:00

connector

…

constrained

[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217 )

2026-08-09 23:45:11 -07:00

debug_utils

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

disaggregation

[PD] Support --enable-unified-memory with PD disaggregation (kimi-linear MLA hybrid-Mamba) (#33362 )

2026-08-10 16:07:58 -07:00

distributed

[AMD] Fix AITER custom reduce-scatter CUDA-graph capture crash under torch_memory_saver (#34203 )

2026-08-10 15:36:15 -07:00

dllm

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

elastic_ep

[Mooncake] Fix ProcessGroup API imports (#32403 )

2026-08-03 01:16:41 -07:00

entrypoints

[inkling] Let Anthropic thinking=disabled map to reasoning effort "none" (#33913 )

2026-08-08 21:59:32 +08:00

eplb

config: route parallel config-leaf reads through get_parallel() (#33170 )

2026-08-01 08:58:39 -07:00

function_call

[Kimi K3] Add reasoning, tool-call, and OpenAI serving support (#33025 )

2026-08-01 14:57:23 -07:00

grpc

…

hardware_backend

[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217 )

2026-08-09 23:45:11 -07:00

kv_canary

Radix Cache Split: Spin off TreeCore (#29901 )

2026-07-25 14:31:59 -07:00

layers

[DCP] Drop two per-layer launches from the MLA target-verify path (#34240 )

2026-08-10 17:11:03 -07:00

lora

Support Intern-S2-Mobius (#33691 )

2026-08-08 11:06:57 +08:00

managers

[PD] Support --enable-unified-memory with PD disaggregation (kimi-linear MLA hybrid-Mamba) (#33362 )

2026-08-10 16:07:58 -07:00

mem_cache

[PD] Support --enable-unified-memory with PD disaggregation (kimi-linear MLA hybrid-Mamba) (#33362 )

2026-08-10 16:07:58 -07:00

model_executor

Fix/hisparse host backed max request length (#28753 )

2026-08-10 16:58:13 +08:00

model_loader

plugins: don't directly set quant class (#34252 )

2026-08-10 16:01:31 -07:00

models

[DCP] Drop two per-layer launches from the MLA target-verify path (#34240 )

2026-08-10 17:11:03 -07:00

multimodal

fix(vlm): stream-order cuda-ipc feature pool lifecycle and streamline multimodal transport module (#33949 )

2026-08-10 18:47:19 +08:00

multiplex

config: read resolved config via namespace accessors (#33013 )

2026-07-31 15:06:59 -07:00

observability

[Fix] Read trace level via get_global_trace_level() in trace_async (#34325 )

2026-08-10 16:46:54 -07:00

parser

[inkling] Render tool-result media instead of coercing content to str (#33898 )

2026-08-08 14:39:19 +08:00

platforms

[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205 )

2026-08-06 08:52:09 +08:00

plugins

…

ray

config: pass the Ray placement group as a launch argument

2026-08-05 19:28:39 -07:00

sampling

Support thinking budget for Inkling (#33146 )

2026-08-11 02:01:08 +08:00

session

feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173 )

2026-08-02 13:43:55 +08:00

speculative

[DSV4] Avoid host syncs in EAGLE prefill (#33662 )

2026-08-10 17:09:55 -07:00

state_capturer

moe: the shared-experts-fusion decision is a per-runner value the loader installs (#33889 )

2026-08-07 22:42:58 -07:00

tokenizer

Add Inkling model support (#31681 )

2026-07-19 22:57:37 -07:00

utils

fix(vlm): stream-order cuda-ipc feature pool lifecycle and streamline multimodal transport module (#33949 )

2026-08-10 18:47:19 +08:00

weight_cache

config: route parallel config-leaf reads through get_parallel() (#33170 )

2026-08-01 08:58:39 -07:00

weight_sync

Introduce WeightUpdater and WeightExporter components (#31148 )

2026-07-14 15:53:33 +08:00

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005 )

2026-06-03 12:55:24 -07:00

environ.py

[unified memory] Support DSPARK speculative decoding + fix two NaN root causes (page hand-out zeroing, CuTe int32 slot-stride wrap) (#33974 )

2026-08-10 10:35:06 -07:00

runtime_context.py

config: the KV-cache configurator reads the bags (#34096 )

2026-08-09 14:45:42 -07:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094 )

2026-06-12 19:27:31 -07:00

server_args.py

[PD] Support --enable-unified-memory with PD disaggregation (kimi-linear MLA hybrid-Mamba) (#33362 )

2026-08-10 16:07:58 -07:00