sglang

4-gpu-models

[Mamba] extra buffer lazy support (#27118 )

2026-06-03 12:42:11 -07:00

8-gpu-models

[CI] Fix nightly test failures (#34523 )

2026-08-12 15:40:20 -07:00

ascend

[NPU] Adapt MiMo-V2.5-W8A8 (#29131 )

2026-07-21 09:16:48 +08:00

attention

fix(attention): read per-runner kv cache dtype off model_runner (#32251 )

2026-07-23 20:08:57 -07:00

chunked_prefill

chore: cleanup garbage code (#29770 )

2026-07-02 16:14:01 +08:00

core

feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173 )

2026-08-02 13:43:55 +08:00

debug_utils

move dead sglang.test files to test/manual (#25316 )

2026-05-14 20:02:44 -07:00

distributed

[Fix] Resolve VLM test image placeholders from the model's own chat template (#33509 )

2026-08-04 02:01:39 -07:00

dsv4

perf(deepseek_v4): enable SGLANG_OPT_FP8_WO_A_GEMM on sm90 (Hopper) (#28983 )

2026-07-16 11:16:32 +08:00

entrypoints/http_server

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

ep

test: fix NIXL EP Mooncake FT test (#32638 )

2026-08-06 18:00:18 +08:00

eval

[CI] slash handler: lookup runs_on from runner_configs.yml (#25394 )

2026-05-15 13:59:00 -07:00

hicache

chore: bump sglang-kernel version to 0.4.1.post1 (#23733 )

2026-04-25 23:23:49 -07:00

kernels

HiSparse: shared-index (IndexShare) plan-then-IO swap-in prefetch (#34329 )

2026-08-11 01:58:28 -07:00

kv_canary

Add KV-canary SWA + DeepSeek-V4 pool support (#26810 )

2026-05-31 09:55:34 +08:00

kv_transfer

Absorb capturer setup and extract the shared-mooncake gate (#31160 )

2026-07-14 16:00:51 +08:00

lang_frontend

[3/N] CI refactor: move some manually triggered tests. (#13448 )

2025-11-19 23:06:53 +08:00

layers

[Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630 ) (#32148 )

2026-07-23 13:47:02 +08:00

lora

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630 , Phase 2) (#30044 )

2026-07-10 21:41:08 +08:00

mla

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

models

Unskip Marlin NVFP4 tests (#27589 )

2026-06-16 11:58:22 -07:00

nightly

[CI] Fix nightly test failures (#34523 )

2026-08-12 15:40:20 -07:00

openai_server

[CI] slash handler: lookup runs_on from runner_configs.yml (#25394 )

2026-05-15 13:59:00 -07:00

perf

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

piecewise_cuda_graph

ci: prune per-commit CUDA tests — move 25 files + 13 testcases to test/manual/ (#24721 )

2026-05-08 15:53:23 -07:00

piecewise_cudagraph

Unify GSM8K eval path to Chat API for regression CI readiness (#21667 )

2026-04-01 17:12:19 -07:00

prefill_only

[CI] slash handler: lookup runs_on from runner_configs.yml (#25394 )

2026-05-15 13:59:00 -07:00

quant

[MXFP8] Use FlashInfer CUTLASS for dense GEMM on SM120, delete Triton path (#33208 )

2026-08-07 14:30:43 -07:00

scheduler

Fix pipeline-parallel abort missing in-flight requests in non-current microbatch slots (#29405 )

2026-07-10 08:53:18 +08:00

spec

[Spec] Rename token resolver to _resolve_spec_v2_tokens; remove dead V1 helpers (#27552 )

2026-06-08 14:42:21 -07:00

vlm

[Perf] Speed up the Kimi-K2.5 vision path and match PIL bicubic in the GPU resize (#33349 )

2026-08-03 21:57:49 -07:00

test_async_dynamic_batch_tokenizer.py

docs: improve CI and testing documentation (#21202 )

2026-03-23 10:48:50 -07:00

test_config_integration.py

docs: improve CI and testing documentation (#21202 )

2026-03-23 10:48:50 -07:00

test_create_custom_4d_mask.py

[CI] Fix lint brought by #27527 (#28988 )

2026-06-22 20:40:06 -07:00

test_cross_node_scheduler_info_sync.py

Fix remote weight info nnode>1 and dp>1 (#17389 )

2026-03-31 21:17:18 +08:00

test_crusoe_backend.py

feat: add Crusoe managed inference backend (#20475 )

2026-05-12 16:23:23 -07:00

test_custom_allreduce.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_deepseek_chat_templates.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_deepseek_v31.py

[CI] Remove profiling from nightly tests (#33832 )

2026-08-06 01:16:08 -07:00

test_dsa_alias_cli_registry_env.py

feat: SM120 (Blackwell Desktop) support for GLM-5.1 inference (#26928 )

2026-07-28 14:52:34 -07:00

test_expert_distribution.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_expert_location_updater.py

enable ut test for xpu devices (#11712 )

2026-02-03 11:15:14 -08:00

test_fim_completion.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_forward_pass_metrics.py

feat: emit per-iteration forward pass metrics via ZMQ PUB (#22789 )

2026-05-12 10:28:17 -07:00

test_forward_split_prefill.py

Pass per-forward overrides to ForwardBatch.init_new as explicit arguments (#30670 )

2026-07-15 14:25:59 +08:00

test_get_weights_by_name.py

enable ut test for xpu devices (#11712 )

2026-02-03 11:15:14 -08:00

test_glm_46_fp8.py

[CI] Remove profiling from nightly tests (#33832 )

2026-08-06 01:16:08 -07:00

test_health_check.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_kda_spec_integration.py

[KDA] Add target_verify support for speculative decoding (#26888 )

2026-07-25 19:52:44 +08:00

test_kda_target_verify.py

[KDA] Add target_verify support for speculative decoding (#26888 )

2026-07-25 19:52:44 +08:00

test_kv_events.py

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

test_logprobs.py

[Refactor] Unify logprob results into a single LogprobResult and rename chunk env vars (#31733 )

2026-07-20 12:44:27 -07:00

test_mla_tp.py

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

test_modelopt_fp8kvcache.py

Fix wrong BaseKVCacheMethod import in test_modelopt_fp8kvcache.py (#20403 )

2026-03-12 00:23:46 -07:00

test_modelopt.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_models_from_modelscope.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_moe_quant_once.py

[DSA] Q8KV8 FP8 Sparse Prefill on GLM-5.2 & DeepSeek-V3.2: Q8-Path & Shared-Path Optimizations (#31888 )

2026-07-30 15:15:11 +08:00

test_mori_transfer_engine_e2e.py

Remove smoke wording from tests and comments (#23355 )

2026-04-28 12:05:27 +08:00

test_quick_allreduce.py

[Bugfix] fix quickreduce acc error in cudagraph mode (#29508 )

2026-07-14 22:16:02 -07:00

test_qwen3_235b.py

[CI] Remove profiling from nightly tests (#33832 )

2026-08-06 01:16:08 -07:00

test_ray_engine.py

feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667 )

2026-05-30 02:19:50 -07:00

test_sagemaker_server.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_schedule_policy.py

Move SWA chunk-cap hatch tests into the registered suite (#33975 )

2026-08-07 17:49:07 +08:00

test_srt_engine_with_quant_args.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_tokenizer_batch_encode.py

[diffusion] feat: add performance mode server args (#24491 )

2026-05-14 00:57:46 +08:00

test_tokenizer_manager.py

[diffusion] feat: add performance mode server args (#24491 )

2026-05-14 00:57:46 +08:00

test_torch_flex_attention_backend.py

Unify GSM8K eval path to Chat API for regression CI readiness (#21667 )

2026-04-01 17:12:19 -07:00

test_torch_tp.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_triton_attention_rocm_mla.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630 , Phase 2) (#30044 )

2026-07-10 21:41:08 +08:00

test_triton_moe_wna16.py

refactor(moe): de-duplicate triton MoE runner path into shared helpers (#23019 )

2026-04-17 17:05:13 -07:00

test_two_batch_overlap.py

Adding correct path for module not found error while collecting test (#19778 )

2026-03-06 16:26:16 -08:00

test_vertex_endpoint.py

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

test_vlm_accuracy.py

Introduce ModelRunner.ps ParallelState (#31161 )

2026-07-14 16:01:14 +08:00

test_w4a8_deepseek_v3.py

[Refactor] Refactor DeepEP dispatcher (#22822 )

2026-05-18 04:36:42 +03:00

test_wave_attention_backend.py

Test reorganization: Move tests to manual/ (#13610 )

2025-11-20 13:41:58 -08:00

test_weight_cache_e2e.py

[FEAT] Support fast engine recovery through weight cache (#27139 )

2026-07-25 14:31:21 +08:00

test_weight_loader_v2_equiv.py

AutoWeightLoader support Sglang native models 1: demo (#28671 )

2026-07-21 14:32:13 -07:00

test_weight_validation.py

Refactor: separate CI-specific weight validation into dedicated module (#15216 )

2025-12-27 20:50:39 -08:00

test_weight_version.py

Revert "tiny remove deprecated endpoint call" (#14533 )

2025-12-05 23:48:54 -08:00

test_whisper_cuda_graph.py

feat: enable CUDA graph and timestamp for the whisper model(#21190 )

2026-03-29 01:46:03 +08:00