sglang

batch_invariant_ops

[Auto Sync] Update batch_invariant_ops.py (20260221) (#19098 )

2026-02-20 18:27:31 -08:00

batch_overlap

[Score API] Add return_pooled_hidden_states to Scoring API for SequenceClassification / RewardModel (#22427 )

2026-04-15 14:58:56 -07:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

configs

Revert "feat: Support MXFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#19143 )" (#23031 )

2026-04-16 21:53:25 -07:00

connector

Remove sync points in mamba cache + prefill cudagraph plumbing for DP (#19639 )

2026-03-02 15:03:42 +08:00

constrained

[Fix] eagle/eagle3 speculative decoding conflicts with xgrammar in NPU (#20989 )

2026-04-15 23:34:23 -07:00

debug_utils

Add e2e demo test in dump comparator (#21031 )

2026-03-20 22:41:01 +08:00

disaggregation

[Bug Fix] Ensure prefill_info_table is populated before honoring disagg_prefill_dp_rank (#22990 )

2026-04-17 11:10:31 +08:00

distributed

[CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119 )

2026-04-19 05:32:36 -07:00

dllm

Decouple scheduler log printing from metrics collection (#20107 )

2026-03-07 22:09:10 -08:00

elastic_ep

[5/N] (Elastic EP) Use GPU P2P to exchange expert weights during EPLB as much as possible (#12068 )

2026-03-16 18:40:58 +08:00

entrypoints

wait for reap in kill_process_tree (#23213 )

2026-04-19 23:36:33 -07:00

eplb

[sgl] perf optimization for eplb (#21232 )

2026-04-14 22:52:17 +08:00

function_call

Fix tool call constrained decoding and parsing for models with native formats (#21593 )

2026-04-10 20:37:23 -07:00

grpc

[gRPC] Extract gRPC servicer into standalone package (#20478 )

2026-03-13 09:13:29 -07:00

hardware_backend

[Refactor] Deduplicate NSA utils.py into cp_utils.py for context parallel (#22914 )

2026-04-19 21:35:35 -07:00

layers

Revert "perf: optimize PCG inductor path for FP8 models (#21734 )" (#23159 )

2026-04-19 23:32:50 -07:00

lora

[main] chore: add bias for base layer with lora (#22169 )

2026-04-18 02:07:02 -07:00

managers

[Refactor] Deduplicate NSA utils.py into cp_utils.py for context parallel (#22914 )

2026-04-19 21:35:35 -07:00

mem_cache

[core] Always-on StreamingSession in UnifiedRadixCache (#23202 )

2026-04-19 21:19:43 -07:00

model_executor

[Refactor] Deduplicate NSA utils.py into cp_utils.py for context parallel (#22914 )

2026-04-19 21:35:35 -07:00

model_loader

feat: add coordinated checkpoint prefetch for network filesystem loading (#20843 )

2026-04-16 20:08:19 -07:00

models

Revert "perf: optimize PCG inductor path for FP8 models (#21734 )" (#23159 )

2026-04-19 23:32:50 -07:00

multimodal

Fix Qwen3.5 video processing when passing video_data in "processor_output" format (#22431 )

2026-04-19 00:04:01 +08:00

multiplex

[mem] Flatten memory checkers into composable per-pool invariant checks (#22562 )

2026-04-11 02:56:22 -07:00

observability

[KV-Events] Fix kv events events publishing for CP (#22983 )

2026-04-20 17:34:38 +08:00

parser

[New Model] Gemma 4 (#21952 )

2026-04-06 20:24:44 -07:00

platforms

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

plugins

Multi platform Plugin (#21388 )

2026-04-19 17:23:51 -07:00

ray

[Ray] Bind scheduler actors to GPU-local NUMA node (#22989 )

2026-04-16 14:52:15 -07:00

sampling

fix: server crash when stop_token_ids contains null (#22175 )

2026-04-10 11:42:23 -07:00

session

[core] Always-on StreamingSession in UnifiedRadixCache (#23202 )

2026-04-19 21:19:43 -07:00

speculative

[AMD] Enable DFLASH speculative decoding on ROCm (#22342 )

2026-04-17 13:10:14 -07:00

tokenizer

[Piecewise Cuda Graph] rename, refactor and add more logging (#13675 )

2025-11-21 13:28:38 +08:00

utils

wait for reap in kill_process_tree (#23213 )

2026-04-19 23:36:33 -07:00

weight_sync

[RL] Allow passing tensors of different dtypes for FlattenedTensorBucket (#13413 )

2025-11-19 17:24:48 +08:00

constants.py

Clean up detokenizer and remove dead multimodal_gen code (#21588 )

2026-03-28 21:44:40 -07:00

environ.py

[gRPC] Native gRPC server: proto + Rust crate scaffold + server args (#22736 )

2026-04-20 12:39:35 +08:00

server_args_config_parser.py

[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051 )

2026-01-16 15:32:42 +08:00

server_args.py

[gRPC] Native gRPC server: proto + Rust crate scaffold + server args (#22736 )

2026-04-20 12:39:35 +08:00