minke.yu/sglang

Files

T

History

Xiaoyu Zhang 7bc9152447 [Test] Consolidate kernel tests under plural kernels tree (#39966 )

2026-09-18 07:37:48 +08:00

..

accuracy/models

[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436 )

2026-09-07 15:13:59 +08:00

[DSV4] Generalize attention metadata, sparse prefill, and KV pool over compress ratios (#39921 )

2026-09-17 15:55:19 -07:00

[DSV4] Generalize attention metadata, sparse prefill, and KV pool over compress ratios (#39921 )

2026-09-17 15:55:19 -07:00

[NVIDIA] Support flashinfer Mega Moe (#31470 )

2026-09-10 00:22:47 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

chunked_prefill

Fix multimodal embedding cache retaining full batches through views (#39120 )

2026-09-12 21:37:14 -07:00

constrained_decoding

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

[CI] Unify basic and speculative sanity accuracy checks with MMLU (#39906 )

2026-09-16 22:19:05 -07:00

[DSV4][BCG] Optimize the heavy memory use of C4 Indexer when BCG is enabled (#36534 )

2026-09-15 17:23:11 -07:00

[CPU] Add fp8_per_tensor_scaled_mm_cpu kernel (#32618 )

2026-09-16 12:31:05 +08:00

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

[XPU] Adapt device agnostic API usage (#32093 )

2026-09-11 10:03:12 +08:00

[Fix][PD] Give prefill and decode their own RDMA NICs in disaggregation tests (#39584 )

2026-09-15 15:07:42 -07:00

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

Re-land dp-attention local control broadcast test (#39835 )

2026-09-17 14:33:25 +08:00

[CI] Wait for a killed test server's GPU memory before the next launch (#39545 )

2026-09-14 23:24:37 -07:00

config: delete the redundant full stamp in initialize_model_parallel (#39202 )

2026-09-12 17:27:21 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

HiCache: Add @rank_consensus to various functions (#37425 )

2026-09-14 10:44:21 +08:00

input_embedding

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

kernel/attention

[Test] Consolidate kernel tests under plural kernels tree (#39966 )

2026-09-18 07:37:48 +08:00

[Test] Consolidate kernel tests under plural kernels tree (#39966 )

2026-09-18 07:37:48 +08:00

Fix KV-canary workspace accounting after graph capture (#38596 )

2026-09-10 16:10:12 -07:00

Fix Qwen3.5 GDN multi-item scoring (#33922 )

2026-09-09 22:30:39 -07:00

[LoRA] Support MoE in full and breakable prefill CUDA graphs (#38578 )

2026-09-11 14:40:02 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436 )

2026-09-07 15:13:59 +08:00

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

[XPU] weekly simple model enablement 2026/09/14 (#39439 )

2026-09-17 10:43:04 +08:00

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

feat(hicache): support NPU Mamba states with FIA and async IO (#32500 )

2026-09-17 10:12:26 +08:00

[AMD] Restore AMD CI registrations dropped by #37436 (#38581 )

2026-09-09 23:59:10 -07:00

[AMD] Restore AMD CI registrations dropped by #37436 (#38581 )

2026-09-09 23:59:10 -07:00

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436 )

2026-09-07 15:13:59 +08:00

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

[Config] msgspec.Struct for the config tier (#38753 )

2026-09-09 19:41:19 -07:00

[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436 )

2026-09-07 15:13:59 +08:00

[CI] Drop the GPTQ dynamic-config test for the deleted non-Marlin kernel (#38881 )

2026-09-10 20:55:06 +08:00

[CI] Run test_unified_radix_cache_kl_dcp on cutedsl_mla with bf16 KV cache (#39553 )

2026-09-15 00:35:01 -07:00

[AMD] Restore AMD CI registrations dropped by #37436 (#38581 )

2026-09-09 23:59:10 -07:00

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

[Rust TreeCore] Harden runtime and CI parity (#37303 )

2026-09-09 10:40:22 +08:00

[Sampling] Support sampling masks with overlap scheduling (#36631 )

2026-09-10 14:52:44 -07:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

scripted_runtime

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

[Session] Fix image append positions and parent metadata (#39145 )

2026-09-13 21:06:47 -07:00

[NPU] Support DFlash speculative decoding for MiMo-V2.5-Pro (mxfp4) (#37565 )

2026-09-12 11:59:23 +08:00

[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436 )

2026-09-07 15:13:59 +08:00

chore: update CI test est_time values (#38238 )

2026-09-06 17:49:41 -07:00

[Test] Consolidate kernel tests under plural kernels tree (#39966 )

2026-09-18 07:37:48 +08:00

[Intel][XPU] Add NUMA node binding support for Intel XPU (#31113 )

2026-09-07 10:39:21 +08:00

fix(multimodal): handle tensor images in exact-token preprocessing (#30368 )

2026-09-17 09:20:21 -07:00

[XPU] weekly simple model enablement 2026/09/14 (#39439 )

2026-09-17 10:43:04 +08:00

README.md

Add pr tests (#31952 )

2026-08-01 15:03:21 +08:00

README.md

Registered Tests

Tests under this directory are auto-discovered by run_suite.py via CI registration decorators.

Where Should I Put My New Test?

No server / engine launch required

What you're testing	Directory	Requires
Component logic in isolation (cache, scheduler, config, parser, etc.)	`unit/<module>/`	CPU or GPU
CUDA kernel correctness	`kernels/`	GPU

Server / engine launch required (E2E)

What you're testing	Directory	Requires
Model inference correctness	`models/`, `4-gpu-models/`, `8-gpu-models/`	GPU
Feature-specific (OpenAI API, LoRA, speculative, distributed, VLM, etc.)	`openai_server/`, `lora/`, `spec/`, `distributed/`, ...	GPU
Benchmarks (performance, accuracy, stress)	`benchmark/`	GPU
Platform-specific	`amd/`, `npu/`	Vendor GPU

See unit/README.md for unit test conventions.