minke.yu/sglang

Files

T

History

Baizhou Zhang eb31a53338 Revert "Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120" (#33455 )

2026-08-03 19:03:56 -07:00

..

[CI] Pin NCCL ports for GB300 PR tests (#33044 )

2026-07-31 02:28:37 -07:00

ci: add LongCat-Flash-Lite-FP8 8-GPU nightly test + fix NextN rope_theta (#32125 )

2026-07-24 19:45:28 +08:00

[AMD] Replace MI325 with MI300 CI Runners (#31409 )

2026-07-29 08:18:07 -07:00

[gdn] fused replayssm ring write into flashinfer gdn mtp verify kernel (#33102 )

2026-08-02 21:31:22 -07:00

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

[misc] Improve benchmark determinism and dataset API coverage (#33255 )

2026-08-02 01:39:50 -07:00

chunked_prefill

test: stand up the config tiers two unit tests read from (#33294 )

2026-08-02 15:46:34 -07:00

constrained_decoding

[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420 )

2026-05-15 18:26:55 -07:00

[Feature] Support return_hidden_states="last" (#30177 )

2026-08-02 15:09:33 +08:00

[CP] Support breakable CUDA graphs for zigzag strategy (#33136 )

2026-08-02 23:11:57 -07:00

[Kernel] Move sgl-kernel under sglang.kernels.aot (#32648 )

2026-07-29 17:25:00 +08:00

[AMD] Pin mem_fraction_static for the piecewise CUDA graph 1-GPU test on MI300 (#32862 )

2026-07-31 14:56:30 -07:00

[Kimi] Support DCP + DSpark (ported from kimi-k3 branch) (#32828 )

2026-07-31 17:39:00 -07:00

Make UTs compatible for XPU (#27106 )

2026-07-15 12:35:56 +08:00

[rust-server] PD disaggregation support (#33125 )

2026-08-02 18:32:59 -07:00

[dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551 )

2026-07-11 11:05:05 +08:00

Enable breakable prefill CUDA graph for DP attention (#30898 )

2026-07-12 17:10:04 -07:00

[Test] split test/registered/distributed/ into topic folders (#26240 )

2026-05-24 17:02:07 -07:00

[CI] Pin NCCL ports for GB300 PR tests (#33044 )

2026-07-31 02:28:37 -07:00

[Kernel] Phase 4 batch-3: migrate tangled JIT subsystems + new groups into kernels.ops (RFC #29630 ) (#32045 )

2026-07-22 21:15:03 +08:00

Fix Mistral GSM8K chat eval (#27757 )

2026-07-09 21:08:48 -07:00

[Kimi K3] Add reasoning, tool-call, and OpenAI serving support (#33025 )

2026-08-01 14:57:23 -07:00

Update GLM tests to 5.2 and delete redundant tests (#29686 )

2026-06-29 23:04:26 -07:00

[Fix] Reject online weight updates while the HPC-Ops router GEMM split cache is active (#31943 )

2026-07-24 19:30:13 +08:00

[Fix] Release hierarchical cache host pool on graceful shutdown (#31746 )

2026-07-19 22:27:29 -07:00

input_embedding

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

[Refactor] Clean up and split DSA indexer (#33443 )

2026-08-03 18:05:01 -07:00

[UnifiedTree]: move /mem_cache/unifed_cache_component dir to /mem_cache/unified_cache (#32484 )

2026-07-28 16:28:21 +08:00

Revert "Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120" (#33455 )

2026-08-03 19:03:56 -07:00

[Kernel] Phase 4 batch-3: migrate tangled JIT subsystems + new groups into kernels.ops (RFC #29630 ) (#32045 )

2026-07-22 21:15:03 +08:00

[Kernel] Relocate vendored fla and mamba kernel trees to sglang.kernels (RFC #29630 , Phase 2.5, 7/7) (#30795 )

2026-07-15 12:52:15 +08:00

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

[Apple Silicon] [CI] Move the MLX lane to the check-changes + pr-gate composite (#30121 )

2026-07-10 22:00:15 -07:00

[Kernel] Phase 4 batch-3: migrate tangled JIT subsystems + new groups into kernels.ops (RFC #29630 ) (#32045 )

2026-07-22 21:15:03 +08:00

[FEAT] Support fast engine recovery through weight cache (#27139 )

2026-07-25 14:31:21 +08:00

Add Inkling per-commit server test (#32095 )

2026-07-22 23:56:18 +08:00

[unified-memory] Support fa3, the default MLA backend on pre-Blackwell hosts (#33046 )

2026-07-31 11:46:46 -07:00

[Attention Backend] Extend hpc_ops dynamic-scheduled decode to bf16 (#32304 )

2026-07-27 21:31:04 +08:00

chore: cleanup garbage code (#29770 )

2026-07-02 16:14:01 +08:00

[NPU] Add PR test cases (#32392 )

2026-08-02 23:00:02 +08:00

[AMD] Register 3 CPU-bound / triton unit + light-integration tests for AMD 1-GPU PR CI (#31088 )

2026-07-15 14:36:05 -07:00

feat: rust sglang server openai apis (#33103 )

2026-08-02 23:13:44 -07:00

config: route parallel config-leaf reads through get_parallel() (#33170 )

2026-08-01 08:58:39 -07:00

feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533 )

2026-06-29 14:49:54 -07:00

[AMD] Replace MI325 with MI300 CI Runners (#31409 )

2026-07-29 08:18:07 -07:00

ci: lower VL PP gsm8k threshold to 0.60 (0.65 has zero margin on H100) (#31702 )

2026-07-19 15:41:12 -07:00

[Fix] Deflake score engine determinism tests (#31494 )

2026-07-16 15:42:47 -07:00

[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420 )

2026-05-15 18:26:55 -07:00

Revert "Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120" (#33455 )

2026-08-03 19:03:56 -07:00

[Feat] DCP + HiCache L2 Support (ported from kimi-k3) (#33112 )

2026-08-02 23:35:27 +08:00

[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420 )

2026-05-15 18:26:55 -07:00

test: recover the config-namespace-migration deferrals (#33171 )

2026-08-01 08:59:27 -07:00

[misc] CI hygiene: enforce __main__ entry, drop silent-skipped tests, fix rerun-test protoc (#23305 )

2026-04-20 21:16:24 -07:00

support rust sglang server (#29799 )

2026-07-31 11:56:31 -07:00

Fix flaky test_sampling_mask: mask length can legitimately be top_k + 1 (#32410 )

2026-07-25 16:05:57 -07:00

Bound prefill delayer all-branch delay and decay the max_prefill_bs high-watermark (#32880 )

2026-08-03 14:43:02 -07:00

scripted_runtime

[AMD] Register 2 CPU-bound 1-GPU tests (phase_checker, scripted_runtime_core) for AMD PR CI (#30446 )

2026-07-08 14:04:23 -07:00

[AMD] ci: add extra-a 1-gpu-large tier (fp8kv-triton, streaming-session, spec-standalone) (#28458 )

2026-06-17 23:31:32 -07:00

[Perf] Skip the target-verify tree mask fill when the backend never reads it (#32886 )

2026-07-30 02:32:38 -07:00

…

[BugFix] Preserve tokenizer worker fanout when skip_tokenizer_init is enabled (#30682 )

2026-07-16 01:29:46 -07:00

[PD] Add a queues.prealloc_ready counter to the load snapshot (#33133 )

2026-08-03 09:44:11 -07:00

refactor(load-snapshot): build LoadSnapshot directly, drop legacy get_loads IPC (#30525 )

2026-07-09 05:58:10 -07:00

[CI] Graceful teardown for kv_canary and EAGLE spec fixtures (#32829 )

2026-08-02 01:09:59 -07:00

[CI] Graceful teardown for kv_canary and EAGLE spec fixtures (#32829 )

2026-08-02 01:09:59 -07:00

README.md

Add pr tests (#31952 )

2026-08-01 15:03:21 +08:00

README.md

Registered Tests

Tests under this directory are auto-discovered by run_suite.py via CI registration decorators.

Where Should I Put My New Test?

No server / engine launch required

What you're testing	Directory	Requires
Component logic in isolation (cache, scheduler, config, parser, etc.)	`unit/<module>/`	CPU or GPU
CUDA kernel correctness	`kernels/`	GPU

Server / engine launch required (E2E)

What you're testing	Directory	Requires
Model inference correctness	`models/`, `4-gpu-models/`, `8-gpu-models/`	GPU
Feature-specific (OpenAI API, LoRA, speculative, distributed, VLM, etc.)	`openai_server/`, `lora/`, `spec/`, `distributed/`, ...	GPU
Benchmarks (performance, accuracy, stress)	`benchmark/`	GPU
Platform-specific	`amd/`, `npu/`	Vendor GPU

See unit/README.md for unit test conventions.