sglang

arg_groups

bugfix: --decrypted-draft-config-file not applied (#25960 )

2026-05-29 09:15:05 +08:00

batch_invariant_ops

Register aten::rms_norm and aten::mm.dtype in batch invariant mode (#24459 )

2026-05-05 17:21:34 -07:00

batch_overlap

Remove dead fields and always-False plumbing across SB / FB / LogitsMetadata (#26551 )

2026-05-28 03:15:04 -07:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

Support piecewise CUDA graph with NSA (#23351 )

2026-05-22 14:39:50 -07:00

configs

model: support Step-3.7-Flash (#26565 )

2026-05-29 08:00:54 +08:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995 )

2026-05-11 14:20:22 -07:00

constrained

[NPU]: Optimize xgrammar token bitmask on NPU with AscendC (#24133 )

2026-05-28 21:38:06 -07:00

debug_utils

Purge usage of pytorch named tensors (#25911 )

2026-05-26 14:58:57 -07:00

disaggregation

[EPD] Optimize the Mooncake backend (#22587 )

2026-05-29 10:42:24 +08:00

distributed

fix(mooncake): honour MOONCAKE_PROTOCOL so EFA hardware can select efa transport (#25083 )

2026-05-29 14:21:15 +08:00

dllm

perf: migrate Req token-id storage to array.array('q') in Scheduler (#25098 )

2026-05-22 10:51:07 -07:00

elastic_ep

chore: bump mooncake version to 0.3.11.post1 (#25989 )

2026-05-25 16:51:03 +08:00

entrypoints

Upgrade xgrammar to 0.2.1 (#25676 )

2026-05-29 11:40:07 +08:00

eplb

[observability] add ServerArgs.stat_loggers for pluggable metrics backend (#24610 )

2026-05-24 22:41:28 +08:00

function_call

Upgrade xgrammar to 0.2.1 (#25676 )

2026-05-29 11:40:07 +08:00

grpc

[gRPC] Extract gRPC servicer into standalone package (#20478 )

2026-03-13 09:13:29 -07:00

hardware_backend

[NPU] Enhance accuracy for model Step3_5 from 0 to 88% (#24582 )

2026-05-29 11:29:30 +08:00

layers

fix: copy seq_lens in TRTLLM MHA draft decode cuda graph capture (#26521 )

2026-05-28 21:55:33 -07:00

lora

[lora] Share MoE LoRA Info (#24160 )

2026-05-29 11:01:47 +09:00

managers

[EPD] Optimize the Mooncake backend (#22587 )

2026-05-29 10:42:24 +08:00

mem_cache

Ensure multi-node MM embedding cache consistency in insert_batch (#25959 )

2026-05-29 13:59:46 +08:00

model_executor

fix(mooncake): honour MOONCAKE_PROTOCOL so EFA hardware can select efa transport (#25083 )

2026-05-29 14:21:15 +08:00

model_loader

GLM-4.7-Flash: standalone MLA impl and MLA NextN/MTP (#26088 )

2026-05-26 13:17:39 +08:00

models

[XPU] Fix Device Assignment (#26257 )

2026-05-29 09:38:11 +08:00

multimodal

[XPU] Fix Device Assignment (#26257 )

2026-05-29 09:38:11 +08:00

multiplex

Move request-ingress methods to SchedulerRequestReceiver (#25610 )

2026-05-18 18:31:17 +08:00

observability

[observability] add ServerArgs.stat_loggers for pluggable metrics backend (#24610 )

2026-05-24 22:41:28 +08:00

parser

[RL][TITO] Preserve whitespace in reasoning parser outputs (#24251 )

2026-05-20 19:45:09 +00:00

platforms

[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821 )

2026-05-20 00:18:04 -07:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

Bundle Scheduler rank/size fields into a frozen ParallelState (#25444 )

2026-05-16 09:23:51 +08:00

sampling

Reject repetition_penalty=0 in SamplingParams.verify() (#24874 )

2026-05-12 21:25:23 -07:00

session

[UnifiedRadixCache] Fix HiCache load back start node (#25088 )

2026-05-14 13:18:12 +08:00

speculative

Support Flashinfer Cute-DSL MLA attention (#24737 )

2026-05-28 00:21:32 -07:00

state_capturer

[Session R3] Add routed_experts_start_len for absolute routing slice control (#24851 )

2026-05-10 10:04:43 -07:00

tokenizer

…

utils

[EPD] Optimize the Mooncake backend (#22587 )

2026-05-29 10:42:24 +08:00

weight_sync

…

constants.py

Clean up detokenizer and remove dead multimodal_gen code (#21588 )

2026-03-28 21:44:40 -07:00

environ.py

fix(mooncake): honour MOONCAKE_PROTOCOL so EFA hardware can select efa transport (#25083 )

2026-05-29 14:21:15 +08:00

server_args_config_parser.py

[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051 )

2026-01-16 15:32:42 +08:00

server_args.py

model: support Step-3.7-Flash (#26565 )

2026-05-29 08:00:54 +08:00