minke.yu/sglang

Files

T

History

Xinyuan Tong db12bfcdc8 [JIT] Add kpool_topk_transform JIT kernel (#28670 )

2026-06-22 01:04:21 -07:00

..

[misc] Make NaN-logit sanitization opt-in (default off) (#28829 )

2026-06-21 14:31:35 -07:00

[Spec] Redo: split init_backends; account draft weights in --mem-fraction-static (#28855 )

2026-06-21 20:45:16 -07:00

Fix lint break on main (#28886 )

2026-06-21 22:46:08 -07:00

[Refactor] Cuda Graph Runner/Backend Refactor (#23906 )

2026-06-09 21:36:57 -07:00

[AMD] register 3 tests to stage-b-test-1-gpu-large-amd (batch-6) (#28736 )

2026-06-19 15:45:16 -07:00

[RL] Fix FlashInfer TRTLLM MXFP8 dense weight layout (#28459 )

2026-06-17 10:33:35 +00:00

Fix multimodal synthetic benchmark prompt generation to exclude special tokens (#26864 )

2026-06-04 22:27:43 +00:00

chunked_prefill

Fix PP is_fully_idle missing in-flight microbatches (#27446 )

2026-06-07 17:38:26 +08:00

constrained_decoding

[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420 )

2026-05-15 18:26:55 -07:00

[AMD] Fix CI base-a fwd_occupancy: disable SGLANG_SANITIZE_NAN_LOGITS in AMD CI (#28075 )

2026-06-12 14:14:34 -07:00

[Spec] Redo: split init_backends; account draft weights in --mem-fraction-static (#28855 )

2026-06-21 20:45:16 -07:00

Add Arm64 INT8 MoE test coverage (#25007 )

2026-06-10 10:36:57 +08:00

[AMD] Make breakable CUDA graph run on ROCm/HIP (#28173 )

2026-06-19 07:16:00 -07:00

[CI] add Precision Regression Test on Nightly Run CI (#26902 )

2026-06-14 12:43:57 +08:00

[Spec] Unify speculative grammar token-accept path in decode processing (#28682 )

2026-06-19 02:49:40 -07:00

[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420 )

2026-05-15 18:26:55 -07:00

[AMD] Register DP attention test (#28495 )

2026-06-21 20:21:41 -07:00

[Test] split test/registered/distributed/ into topic folders (#26240 )

2026-05-24 17:02:07 -07:00

[Spec] Retire Spec V1 (#27964 )

2026-06-11 16:15:15 -07:00

LPLB: linear-programming load balancer for MoE expert parallelism (#24515 )

2026-06-16 10:19:42 -07:00

test: fix gemma GSM8K thresholds in nightly text eval (#27342 )

2026-06-08 19:58:42 -07:00

[Xeon] CPU CI enhancement for Intel Xeon platforms (#24649 )

2026-05-28 10:49:04 +08:00

ci: run GB300 nightly suite in the standard Nvidia nightly workflow (#28536 )

2026-06-19 12:24:38 -07:00

[CI]: Fix CI Stage for 3fs backend test (#27388 )

2026-06-06 00:38:03 +08:00

input_embedding

Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637 )

2026-06-08 14:52:18 +08:00

[JIT] Add kpool_topk_transform JIT kernel (#28670 )

2026-06-22 01:04:21 -07:00

Add get_parallel(): a structured accessor for parallel-topology state (#28567 )

2026-06-17 20:23:43 -07:00

[misc] Move bench_one_batch_server into sglang/benchmark/ with a back-compat shim (#28625 )

2026-06-19 14:19:29 -07:00

Add get_parallel(): a structured accessor for parallel-topology state (#28567 )

2026-06-17 20:23:43 -07:00

[AMD] register 3 tests to stage-b-test-1-gpu-large-amd (batch-6) (#28736 )

2026-06-19 15:45:16 -07:00

Support spec v2 for FlashMLA speculative decoding (#24640 )

2026-05-19 15:23:17 -07:00

[AMD] ci: add label-gated extra-a tier (kv_canary + mock_model unit tests) (#27822 )

2026-06-12 15:12:56 -07:00

[Refactor] Cuda Graph Runner/Backend Refactor (#23906 )

2026-06-09 21:36:57 -07:00

[AMD] ci: register 8 framework / unit tests to run on AMD CI (#25939 )

2026-06-10 08:41:22 -07:00

[Spec] Redo: split init_backends; account draft weights in --mem-fraction-static (#28855 )

2026-06-21 20:45:16 -07:00

correct allreduce fusion and dummy_run alignment in SCATTERED MLP mode (moe_dense_tp_size=1) (#19918 )

2026-05-22 19:18:25 -07:00

[MUSA][23/N] CI: Fix torchada preflight lock cleanup and add LLM server smoke test (#27242 )

2026-06-08 08:45:16 -07:00

[observability] add Ray metric backend wrappers (#26252 )

2026-06-17 19:41:53 -07:00

fix(anthropic): handle mid-conversation system messages (#26773 )

2026-06-21 04:34:47 +00:00

[AMD] Relax allreduce-fusion residual accuracy tolerance to 1 bf16 ULP (#28226 )

2026-06-18 19:18:53 -07:00

[Spec] Retire Spec V1 (#27964 )

2026-06-11 16:15:15 -07:00

[CI] Split PP tests into base and extra suites (#26648 )

2026-05-29 12:15:27 +08:00

fix(fa3): no NaN embeddings with fa_skip_kv_cache under piecewise CUDA graph (#27343 )

2026-06-15 13:46:22 -07:00

[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420 )

2026-05-15 18:26:55 -07:00

[AMD] ci: add extra-a 1-gpu-large tier (fp8kv-triton, streaming-session, spec-standalone) (#28458 )

2026-06-17 23:31:32 -07:00

[Spec] Redo: split init_backends; account draft weights in --mem-fraction-static (#28855 )

2026-06-21 20:45:16 -07:00

[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420 )

2026-05-15 18:26:55 -07:00

[RL] Fix FlashInfer TRTLLM MXFP8 dense weight layout (#28459 )

2026-06-17 10:33:35 +00:00

[misc] CI hygiene: enforce __main__ entry, drop silent-skipped tests, fix rerun-test protoc (#23305 )

2026-04-20 21:16:24 -07:00

[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420 )

2026-05-15 18:26:55 -07:00

[AMD] register 4 2-gpu tests to stage-b-test-2-gpu-large-amd (#28344 )

2026-06-16 21:58:34 -07:00

scripted_runtime

Add scripted-runtime unit, core integration, and chunked-prefill tests (#27413 )

2026-06-06 09:08:35 +08:00

[AMD] ci: add extra-a 1-gpu-large tier (fp8kv-triton, streaming-session, spec-standalone) (#28458 )

2026-06-17 23:31:32 -07:00

[mtp] add rejection sampling for speculative decoding (#26312 )

2026-06-20 15:10:42 -07:00

Add stress test workflow (#13937 )

2025-11-26 13:24:39 -08:00

[CI] Enforce modern stage=/runner_config= form for dispatchable test suites (#28108 )

2026-06-12 17:32:54 -07:00

Migrate more server args to annotated style (#28830 )

2026-06-21 20:50:17 -07:00

[CI] Reclaim leaked /dev/shm segments on server startup (#28089 )

2026-06-15 16:14:08 -07:00

[CI] Enforce modern stage=/runner_config= form for dispatchable test suites (#28108 )

2026-06-12 17:32:54 -07:00

test(xpu): add multi-feature and embedding stage-b tests (#27861 )

2026-06-12 14:36:28 +08:00

README.md

[CI] Add READMEs for unit test directory structure (#20626 )

2026-03-15 20:27:05 +08:00

README.md

Registered Tests

Tests under this directory are auto-discovered by run_suite.py via CI registration decorators.

Where Should I Put My New Test?

No server / engine launch required

What you're testing	Directory	Requires
Component logic in isolation (cache, scheduler, config, parser, etc.)	`unit/<module>/`	CPU or GPU
CUDA kernel correctness	`kernels/`	GPU

Server / engine launch required (E2E)

What you're testing	Directory	Requires
Model inference correctness	`models/`, `4-gpu-models/`, `8-gpu-models/`	GPU
Feature-specific (OpenAI API, LoRA, speculative, distributed, VLM, etc.)	`openai_server/`, `lora/`, `spec/`, `distributed/`, ...	GPU
Benchmarks (performance, accuracy, stress)	`benchmark/`	GPU
Platform-specific	`amd/`, `ascend/`	Vendor GPU

See unit/README.md for unit test conventions.