sglang

ascend

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

ci

[misc] Move bench_serving into sglang.benchmark (#28996 )

2026-06-23 19:34:11 -07:00

external_models

Fix external_models import path and migrate model loading tests (#16458 )

2026-01-08 23:43:49 -08:00

kits

Share one logits output buffer across prefill/decode/draft cuda-graph runners (#29779 )

2026-07-01 23:30:56 -07:00

kv_canary

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

manual/disaggregation

Abort during chunked prefill + PD peer-liveness abort (#28086 )

2026-06-17 23:13:28 -07:00

mock_model

[misc] Move bench_serving into sglang.benchmark (#28996 )

2026-06-23 19:34:11 -07:00

observability

[observability] add Ray metric backend wrappers (#26252 )

2026-06-17 19:41:53 -07:00

scripted_runtime

Convert IPC dataclasses to msgspec.Struct with opt-in msgpack transport (#28688 )

2026-06-26 12:04:03 -07:00

server_fixtures

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

xpu

[Intel XPU] Initially add nightly GSM8K accuracy tests for Llama-3.1-8B (TP=2) and Qwen3-32B (TP=4) (#28908 )

2026-07-01 16:27:24 +08:00

__init__.py

Fix circular imports in gptq.py and unblock test explorer (#4736 )

2025-03-24 18:07:08 -07:00

accuracy_test_runner.py

[CI] pin NeMo-Skills install to known-good SHA in accuracy_test_runner (#24581 )

2026-05-06 22:24:48 -07:00

chunked_prefill_test_utils.py

Add more testing for chunked prefill (#27506 )

2026-06-09 20:19:30 +08:00

doc_patch.py

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

few_shot_gsm8k_engine.py

Unify GSM8K eval path to Chat API for regression CI readiness (#21667 )

2026-04-01 17:12:19 -07:00

few_shot_gsm8k.py

Unify GSM8K eval path to Chat API for regression CI readiness (#21667 )

2026-04-01 17:12:19 -07:00

gpt_oss_common.py

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

hicache_spec_storage_common.py

[HiCache] feat: support draft offload for mooncake (#24984 )

2026-06-02 21:42:04 -07:00

kl_multiturn_utils.py

[UnifiedTree] Support DeepSeek V4 host pool with multiple layouts. (#25282 )

2026-05-19 09:36:00 +08:00

kl_test_utils.py

[Mamba] extra buffer lazy support (#27118 )

2026-06-03 12:42:11 -07:00

long_prompt.txt

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926 )

2024-11-06 13:46:04 +00:00

lora_utils.py

[LoRA] Torch Native enhancement: embedding and graph optimization (#21885 )

2026-05-07 17:28:38 +03:00

nightly_bench_utils.py

Upload nightly test metrics to GH artifacts (#17696 )

2026-01-25 14:35:14 -08:00

nightly_utils.py

[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821 )

2026-05-20 00:18:04 -07:00

otel_collector.py

feat: add OpenTelemetry tracing to DiffGenerator (#21254 )

2026-04-23 09:25:23 -07:00

performance_test_runner.py

[CI] Fix false spec accept length failure after profiling phase (#29329 )

2026-06-25 22:19:30 -07:00

precision_baseline_store.py

fix(precision): do not promote failed runs to the comparison baseline (#28190 )

2026-07-01 18:19:15 -07:00

run_combined_tests.py

feat(ci): add GB300 nightly benchmark test suites (#21487 )

2026-03-28 21:54:03 -07:00

run_eval.py

Add mixed-prefix gsm8k eval and its CPU unit test (#27502 )

2026-06-09 20:17:41 +08:00

runners.py

[Refactor] Cuda Graph Runner/Backend Refactor (#23906 )

2026-06-09 21:36:57 -07:00

scripted_runtime_chunked_helpers.py

Add more testing for chunked prefill (#27506 )

2026-06-09 20:19:30 +08:00

send_one.py

[misc] Share bench HTTP-client base-URL resolution with IPv6-compatible formatting (#28598 )

2026-06-17 20:50:49 -07:00

simple_eval_aime25.py

[Feature] Add AIME25 dataset support for SGLang simple_eval (#14990 )

2025-12-15 21:59:40 -08:00

simple_eval_common.py

[diffusion] feat: add performance mode server args (#24491 )

2026-05-14 00:57:46 +08:00

simple_eval_gpqa.py

[Misc] Add network timeout to eval dataset downloads (#21873 )

2026-04-01 13:16:14 -07:00

simple_eval_gsm8k.py

Add mixed-prefix gsm8k eval and its CPU unit test (#27502 )

2026-06-09 20:17:41 +08:00

simple_eval_humaneval.py

Allow benchmarking tool to handle empty response (#12174 )

2025-10-29 20:26:23 -07:00

simple_eval_longbench_v2.py

[Fix] Improve longbench prompt and other logics (#11474 )

2025-10-12 15:04:28 -07:00

simple_eval_math.py

[Misc] Add network timeout to eval dataset downloads (#21873 )

2026-04-01 13:16:14 -07:00

simple_eval_mgsm.py

[Misc] Tiny: Add test network timeouts and dynamic max-parallel for 5090/2-gpu runners (#21800 )

2026-03-31 18:27:39 -07:00

simple_eval_mixed_prefix_gsm8k.py

Add mixed-prefix gsm8k eval and its CPU unit test (#27502 )

2026-06-09 20:17:41 +08:00

simple_eval_mmlu.py

[Misc] Add network timeout to eval dataset downloads (#21873 )

2026-04-01 13:16:14 -07:00

simple_eval_mmmu_vlm.py

[VLM] Add VLM TP=4 per-commit CI test and improve MMMU eval prompt/parser (#21841 )

2026-04-01 20:09:47 -07:00

test_deepep_utils.py

Add DeepEP to CI PR Test (#5655 )

2025-05-06 17:36:03 -07:00

test_deterministic_utils.py

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

test_deterministic.py

[Auto Sync] Update test_deterministic.py (20260214) (#18839 )

2026-02-14 17:19:30 -08:00

test_marlin_utils.py

Feat/add w4a16 moe support to nemotron (#25655 )

2026-06-02 22:42:26 -07:00

test_programs.py

[Test] Add fwd_occupancy sanity kit (#25886 )

2026-05-20 03:34:37 -07:00

test_utils.py

feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533 )

2026-06-29 14:49:54 -07:00

tool_call_test_runner.py

Fix parallel tool call test for speculative decoding variants (#19370 )

2026-02-26 18:31:20 -08:00

vlm_utils.py

[Misc] Tiny: Add test network timeouts and dynamic max-parallel for 5090/2-gpu runners (#21800 )

2026-03-31 18:27:39 -07:00