sglang

ascend

[NPU] Support GGUF quantization for Ascend NPU (dense + MoE) (#17883 )

2026-04-25 17:16:47 +03:00

attention

[Test] Add XPU device support to unit tests (#22236 )

2026-05-01 07:18:51 +08:00

ci

[misc] CI hygiene: enforce __main__ entry, drop silent-skipped tests, fix rerun-test protoc (#23305 )

2026-04-20 21:16:24 -07:00

external_models

Fix external_models import path and migrate model loading tests (#16458 )

2026-01-08 23:43:49 -08:00

kits

[Spec] Split accept_length into num_accepted_drafts and num_accepted_tokens (#23962 )

2026-04-29 00:02:22 -07:00

longbench_v2

Feature/longbench v2 evaluation utils (#10949 )

2025-10-07 14:17:31 +08:00

server_fixtures

[Feature] Xiaomi MiMo-V2.5 day0 support (#23811 )

2026-05-01 00:02:26 +08:00

speculative

Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode (#7725 )

2025-11-26 11:44:41 +08:00

__init__.py

Fix circular imports in gptq.py and unblock test explorer (#4736 )

2025-03-24 18:07:08 -07:00

accuracy_test_runner.py

[CI] Lower GSM8K baselines for B200 nightly after eval unification (#22136 )

2026-04-22 22:30:54 -07:00

bench_one_batch_server_internal.py

[Lora] Support LoRA and multi-batch in bench_one_batch_server (#23047 )

2026-04-21 14:20:11 -07:00

doc_patch.py

[CI] fix: notebook ci often OOM (#20199 )

2026-03-09 22:32:41 -07:00

few_shot_gsm8k_engine.py

Unify GSM8K eval path to Chat API for regression CI readiness (#21667 )

2026-04-01 17:12:19 -07:00

few_shot_gsm8k.py

Unify GSM8K eval path to Chat API for regression CI readiness (#21667 )

2026-04-01 17:12:19 -07:00

get_logits_ut.py

Support DeepSeek V3.2 Exp (#11061 )

2025-10-06 00:24:15 -07:00

gpt_oss_common.py

[AMD] rocm 7.2 image release, PR test, Nightly Test (#17799 )

2026-02-11 21:29:25 -08:00

kl_multiturn_utils.py

[RaidxTree Refactor]: Support Unified HybridRadixTree V2 (#21206 )

2026-04-13 10:28:22 +08:00

kl_test_utils.py

Migrate all callers from /get_server_info to /server_info (#21463 )

2026-04-01 21:17:50 -07:00

long_prompt.txt

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926 )

2024-11-06 13:46:04 +00:00

lora_utils.py

[CI][LoRA] Drop flaky all-None batch from multi-LoRA parity test (#23287 )

2026-04-20 14:43:25 -07:00

nightly_bench_utils.py

Upload nightly test metrics to GH artifacts (#17696 )

2026-01-25 14:35:14 -08:00

nightly_utils.py

Migrate all callers from /get_server_info to /server_info (#21463 )

2026-04-01 21:17:50 -07:00

otel_collector.py

feat: add OpenTelemetry tracing to DiffGenerator (#21254 )

2026-04-23 09:25:23 -07:00

performance_test_runner.py

Enable SGLANG_ENABLE_SPEC_V2 for nightly speculative decoding tests (#18719 )

2026-02-14 23:00:33 +08:00

run_combined_tests.py

feat(ci): add GB300 nightly benchmark test suites (#21487 )

2026-03-28 21:54:03 -07:00

run_eval.py

Unify GSM8K eval path to Chat API for regression CI readiness (#21667 )

2026-04-01 17:12:19 -07:00

runners.py

[Spec][Ngram] 4/N: Remove max_match_window_size and min_match_window_size, matching all suffixes of the Trie (#21225 )

2026-04-01 22:09:46 -07:00

send_one.py

Replace clamp_position with JIT kernel + platform dispatch (#20999 )

2026-03-21 21:26:26 -07:00

simple_eval_aime25.py

[Feature] Add AIME25 dataset support for SGLang simple_eval (#14990 )

2025-12-15 21:59:40 -08:00

simple_eval_common.py

Unify GSM8K eval path to Chat API for regression CI readiness (#21667 )

2026-04-01 17:12:19 -07:00

simple_eval_gpqa.py

[Misc] Add network timeout to eval dataset downloads (#21873 )

2026-04-01 13:16:14 -07:00

simple_eval_gsm8k.py

[eval] GSM8k support for run_eval (#17041 )

2026-01-16 11:10:17 +08:00

simple_eval_humaneval.py

Allow benchmarking tool to handle empty response (#12174 )

2025-10-29 20:26:23 -07:00

simple_eval_longbench_v2.py

[Fix] Improve longbench prompt and other logics (#11474 )

2025-10-12 15:04:28 -07:00

simple_eval_math.py

[Misc] Add network timeout to eval dataset downloads (#21873 )

2026-04-01 13:16:14 -07:00

simple_eval_mgsm.py

[Misc] Tiny: Add test network timeouts and dynamic max-parallel for 5090/2-gpu runners (#21800 )

2026-03-31 18:27:39 -07:00

simple_eval_mmlu.py

[Misc] Add network timeout to eval dataset downloads (#21873 )

2026-04-01 13:16:14 -07:00

simple_eval_mmmu_vlm.py

[VLM] Add VLM TP=4 per-commit CI test and improve MMMU eval prompt/parser (#21841 )

2026-04-01 20:09:47 -07:00

test_activation.py

[AMD] Add silu_and_mul, gelu_and_mul, gelu_tanh_and_mul, and gelu_quick kernels for AMD GPUs (#7135 )

2025-07-24 23:44:28 -07:00

test_block_fp8_deep_gemm_blackwell.py

[1/2] Refactor DeepGeem requant for FP8 Linear on Blackwell (#13601 )

2025-11-23 16:07:56 -08:00

test_block_fp8.py

refactor(moe): de-duplicate triton MoE runner path into shared helpers (#23019 )

2026-04-17 17:05:13 -07:00

test_custom_ops.py

docs: improve CI and testing documentation (#21202 )

2026-03-23 10:48:50 -07:00

test_cutlass_moe.py

refactor(moe): de-duplicate triton MoE runner path into shared helpers (#23019 )

2026-04-17 17:05:13 -07:00

test_cutlass_w4a8_moe.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

test_cutlass_w16a16_moe.py

Add support for bf16 x bf16 cutlass fused MoE (#10275 )

2025-11-24 18:49:39 -08:00

test_deepep_utils.py

Add DeepEP to CI PR Test (#5655 )

2025-05-06 17:36:03 -07:00

test_deterministic_utils.py

[Auto Sync] Update test_deterministic.py, test_deterministi... (20251024) (#12083 )

2025-10-24 22:28:01 -07:00

test_deterministic.py

[Auto Sync] Update test_deterministic.py (20260214) (#18839 )

2026-02-14 17:19:30 -08:00

test_dump_metric.py

Add unified metrics collection framework (v1) (#16064 )

2026-01-03 16:30:38 -08:00

test_dynamic_grad_mode.py

Add retry for flaky tests in CI (#4755 )

2025-03-25 16:53:12 -07:00

test_flashinfer_dispatcher.py

[NVIDIA] Add flashinfer all-to-all MOE dispatcher (#14668 )

2026-01-24 22:59:55 +08:00

test_kvfp4_quant_dequant.py

feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078 )

2025-11-01 22:24:58 -07:00

test_layernorm.py

Enable mixed type LayerNorm kernel for NSA indexer (#12044 )

2025-11-03 16:50:41 -08:00

test_marlin_utils.py

Replace sglang.srt.layers.quantization.scalar_types with sgl_kernel.scalar_type (#8951 )

2025-08-13 19:41:41 -07:00

test_mm_utils.py

[VLM] Enable per-image MM splitting by default and remove MULTI_IMAGES modality (#21899 )

2026-04-03 11:04:41 +08:00

test_programs.py

Align incremental streaming logprobs with streamed output tokens (#21583 )

2026-04-06 00:30:02 -07:00

test_utils.py

[CI] Fix stage-b-test-1-gpu-large (0) timeout by reordering LoRA tests and using tokenizer from cache (#22292 )

2026-04-07 20:00:44 -07:00

tool_call_test_runner.py

Fix parallel tool call test for speculative decoding variants (#19370 )

2026-02-26 18:31:20 -08:00

vlm_utils.py

[Misc] Tiny: Add test network timeouts and dynamic max-parallel for 5090/2-gpu runners (#21800 )

2026-03-31 18:27:39 -07:00