SII-yangdianandSII-yangdian f2b2b567aa perf(jit_kernel/deepseek_v4): optimize paged_mqa_metadata (#25855) ...

Co-authored-by: SII-yangdian <yangdian@sii.edu.cn>

2026-08-13 19:00:22 -07:00

..

asr

model: support qwen3-asr (#22073)

2026-04-07 13:27:05 +08:00

bench_attention_sink

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)

2026-07-10 21:41:08 +08:00

bench_linear_attention

[Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels (#32072)

2026-07-23 08:35:09 +08:00

bench_pynccl_allocator

Refactor: decouple segment tracking from comm registration (#21392)

2026-05-06 17:07:58 +08:00

bench_rope

Remove smoke wording from tests and comments (#23355)

2026-04-28 12:05:27 +08:00

blog_v0_2

Add Lychee Doc Links Check to Local and CI (#19742)

2026-03-24 13:48:26 -07:00

boolq

[NPU]TP Communications compression For Qwen3 models for NPU (#20520)

2026-05-02 14:29:11 +03:00

deepseek_v3

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)

2026-06-28 18:38:28 -07:00

fla

[Kernel] Relocate vendored fla and mamba kernel trees to sglang.kernels (RFC #29630, Phase 2.5, 7/7) (#30795)

2026-07-15 12:52:15 +08:00

gsm8k

[Benchmark] Remove 22 unmaintained benchmarks (#34520)

2026-08-11 22:24:43 -07:00

hellaswag

[Benchmark] Remove 22 unmaintained benchmarks (#34520)

2026-08-11 22:24:43 -07:00

hf3fs

[HiCache] Optimize L2 mem allocation when cache miss in L3 (#19320)

2026-07-16 15:00:53 -07:00

hicache

[Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels (#32072)

2026-07-23 08:35:09 +08:00

io

API Perf: Replace pydantic per-element validation with C loop validation (#26355)

2026-05-27 02:04:07 -07:00

kernels

perf(jit_kernel/deepseek_v4): optimize paged_mqa_metadata (#25855)

2026-08-13 19:00:22 -07:00

llava_bench

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

lora

benchmark/lora: make number of LoRA adapters configurable (#25363)

2026-05-20 18:23:13 -07:00

mmlu

[Benchmark] Remove 22 unmaintained benchmarks (#34520)

2026-08-11 22:24:43 -07:00

mmmu

Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964)

2026-07-13 15:06:08 -07:00

ocr

Add Accuracy Benchmark for OCR models (#25364)

2026-07-06 16:18:43 +08:00

prefill_only

Add overlap scheduling for embeddings code path (#14032)

2025-12-24 18:24:18 -08:00

scheduler

perf: migrate Req token-id storage to array.array('q') in Scheduler (#25098)

2026-05-22 10:51:07 -07:00

bench_adaptive_speculative.py

[SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599)

2026-04-20 14:25:04 -07:00