sglang

batch_invariant_ops

[Auto Sync] Update batch_invariant_ops.py (20260221) (#19098 )

2026-02-20 18:27:31 -08:00

batch_overlap

Revert "[AMD] support two batch overlapping for mori ep #17953 " (#19161 )

2026-02-23 01:19:23 +08:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

Fix PCG MoE Error (#17739 )

2026-02-19 16:48:06 +08:00

configs

Whisper model support & /v1/audio/transcriptions endpoint & benchmark (#16983 )

2026-02-23 17:28:37 -08:00

connector

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

constrained

Fix grammar sync across TP ranks (#17100 )

2026-01-15 18:38:01 -08:00

debug_utils

Support kwargs and megatron core tensor parsing in dumper (#19138 )

2026-02-22 16:24:33 +08:00

disaggregation

[PD-Disagg] Improve type hints across all conn.py (#19208 )

2026-02-23 19:44:23 -08:00

distributed

[ROCm] Use unreg path for custom all-reduce during CUDA graph capture (#19162 )

2026-02-22 23:27:31 -08:00

dllm

[BUG] [DLLM] Missing max_running_requests value (#18740 )

2026-02-22 13:38:56 +08:00

elastic_ep

[2/N] Added the core structure of elastic EP and the eplb algorithm with faulty rank (#10606 )

2025-10-22 01:13:31 -07:00

entrypoints

fix: add missing blank line after docstring in serving_transcription.py (#19206 )

2026-02-23 18:29:38 -08:00

eplb

Re-introduce the unit test of test_mooncake_ep_small (#16019 )

2026-01-12 17:01:24 +08:00

function_call

fix KimiK2Detector regex patterns with re.DOTALL (#19120 )

2026-02-21 22:13:08 +08:00

grpc

[gRPC] Fix scheduler startup broken by context parallel refactor (#18933 )

2026-02-17 08:52:11 -08:00

hardware_backend/npu

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

layers

[Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949 )

2026-02-23 22:05:27 +08:00

lora

[Fix] Add lora tied lm head support (for Qwen2.5, Gemma, etc model need) (#18634 )

2026-02-19 00:34:51 +08:00

managers

[PD-Disagg] Improve type hints across all conn.py (#19208 )

2026-02-23 19:44:23 -08:00

mem_cache

Fix long prompt KV allocation by falling back to torch native APIs when exceeding Triton tensor limit (#18250 )

2026-02-19 19:15:05 -08:00

metrics

cleanup prefill metrics logging to fix dp-attn metrics (#18778 )

2026-02-17 14:35:35 -08:00

model_executor

Revert "Refactor graph input buffers (#18991 )" (#19173 )

2026-02-23 13:09:54 +08:00

model_loader

[Quantization] Support config.json quantization_config format, fix exclude_modules matching, and fix KV cache scale loading for Nemotron (#18546 )

2026-02-21 16:14:29 +08:00

models

Whisper model support & /v1/audio/transcriptions endpoint & benchmark (#16983 )

2026-02-23 17:28:37 -08:00

multimodal

Whisper model support & /v1/audio/transcriptions endpoint & benchmark (#16983 )

2026-02-23 17:28:37 -08:00

multiplex

[Bugfix] fix the display error (inconsistent context) (#17699 )

2026-01-31 23:35:11 -08:00

parser

Whisper model support & /v1/audio/transcriptions endpoint & benchmark (#16983 )

2026-02-23 17:28:37 -08:00

sampling

Revert "feat: reduce constrained-decoding overhead in TP" (#16845 )

2026-01-10 11:39:38 +08:00

speculative

Revert "Refactor graph input buffers (#18991 )" (#19173 )

2026-02-23 13:09:54 +08:00

tokenizer

[Piecewise Cuda Graph] rename, refactor and add more logging (#13675 )

2025-11-21 13:28:38 +08:00

tracing

SGLang Tracing: Improve root span attributes (#17008 )

2026-01-30 16:02:05 +08:00

utils

Fix libnuma.so does not exsit (#15355 )

2026-02-16 00:37:50 +08:00

weight_sync

[RL] Allow passing tensors of different dtypes for FlattenedTensorBucket (#13413 )

2025-11-19 17:24:48 +08:00

constants.py

Support releasing CUDA graph memory when paused (#7873 )

2025-10-28 14:40:50 +08:00

environ.py

[PD-Disagg] Support query dp rank from bootstrap server. (#19168 )

2026-02-23 10:59:30 -08:00

server_args_config_parser.py

[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051 )

2026-01-16 15:32:42 +08:00

server_args.py

[PD-Disagg] Improve type hints across all conn.py (#19208 )

2026-02-23 19:44:23 -08:00