minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,824 Commits 3 Branches 0 Tags
cfd49e233ceb94de3f702f70aef06e299836aede
Commit Graph
98 Commits
Author SHA1 Message Date
Vladislav Nosivskoy 4028a73c10 [KV-Events] Fix kv events events publishing for CP (#22983) 
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
 2026-04-20 17:34:38 +08:00
Baizhou ZhangKangyan ZhouClaude Opus 4.7Alison ShaoMick
 		6ecd6f84db [CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-04-19 05:32:36 -07:00
Cheng WanandClaude Opus 4.7 5f7aee726a refactor(moe): de-duplicate triton MoE runner path into shared helpers (#23019) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-17 17:05:13 -07:00
Lianmin Zheng 44e67c6835 Remove deprecated double sparsity feature (#23009) 2026-04-17 13:33:12 -07:00
Xinyu Zhangandxyuzh 13a2cd748d [Ray] Add data parallel (DP) and DP attention support to RayEngine (#21887) 
Co-authored-by: xyuzh <xyuzh@users.noreply.github.com>
 2026-04-15 15:00:48 -07:00
Alex NailsandClaude Opus 4.6 8eac618a8d [tokenizer] lazy text accumulation + use deltas directly for streaming (#22548) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-10 21:26:04 -07:00
Alex Nails 0af9166474 [tokenizer] improve non streaming request processing + some small fixes. (#20310) 2026-04-10 15:46:12 -07:00
satyamk7054andSatyam Kumar 059b287e25 Add offline auto-tuning for LoRA CSGMV kernel (#20391) 
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
 2026-04-10 13:10:43 -07:00
Yihao Wang a5ed507a16 [refactor] [asr] add transcription adapter for extensible ASR models support (#22181) 2026-04-09 01:19:37 +08:00
Alison ShaoandAlison Shao 36f05810c9 [CI] Move manual-only nightly tests out of test/registered/ (#22298) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-07 21:03:52 -07:00
Feng Su 8732b2e9c6 [CI] [Tracing] Add ci for tracing and fix bugs (#21740) 2026-04-02 10:50:50 -07:00
foraxeandyunzhi e55a35fbcd test: add manual init test for mooncake transfer engine (#21842) 
Co-authored-by: yunzhi <ningyunxiao.nyx@antgroup.com>
 2026-04-02 16:01:10 +08:00
Liangsheng Yin d7256eb69a Unify GSM8K eval path to Chat API for regression CI readiness (#21667) 2026-04-01 17:12:19 -07:00
Yuhao Yang 1aabe44b64 [VLM] remove AsyncMMDataProcessor wrapper (#21651) 2026-04-01 17:39:50 +08:00
Ethan (Yusheng) SuandBaizhou Zhang cffc95edf4 [3/n] lora moe - Support Qwen3-VL-30B-A3B-Instruct (#21469) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-31 23:15:16 -07:00
JD 20d07c4384 Fix remote weight info nnode>1 and dp>1 (#17389) 2026-03-31 21:17:18 +08:00
Xinyuan Tong ced69c9f84 feat: enable CUDA graph and timestamp for the whisper model(#21190) 2026-03-29 01:46:03 +08:00
Liangsheng Yin 8a4cdcd538 Simplify flush_cache: reject concurrent requests, remove client-side retry (#21490) 2026-03-26 16:31:04 -07:00
satyamk7054andSatyam Kumar e59ea4f6e9 fix: torch-native LoRA for multi-adapter case (#20564) 
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
 2026-03-26 14:34:16 -07:00
Baizhou Zhang ed316a26ef Fix CP in-seq-split method for DeepSeek V32 and update related tests (#21192) 2026-03-23 12:34:10 -07:00
Lianmin ZhengandClaude Opus 4.6 27ac831a84 docs: improve CI and testing documentation (#21202) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-23 10:48:50 -07:00
Liangsheng Yin 4d3976b6c5 [HiCache] Check in-flight async ops in is_fully_idle() before attach/detach (#20746) 2026-03-17 17:28:26 -07:00
Bruce WuBruce WuBaizhou ZhangEthan Su
 		70a6fb53af Enable embedding lookup/lora_a logic for chunked backend (#17692) 
Co-authored-by: Bruce Wu <mogicianwu@fb.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
 2026-03-16 11:37:58 -07:00
Liangsheng Yin f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
Liangsheng Yin fc7f9c1de7 Rename --stream-output to --incremental-streaming-output (#20614) 2026-03-14 23:22:33 -07:00
Qiaolin Yu 9c6f166600 tiny fix the usage of test_logprobs (#20473) 2026-03-12 15:37:45 -07:00
Pai Liu ac1310b300 Fix wrong BaseKVCacheMethod import in test_modelopt_fp8kvcache.py (#20403) 2026-03-12 00:23:46 -07:00
Pai Liu 2c03a5c6c7 Fix global server args not set error in test_triton_moe_wna16.py (#20412) 2026-03-12 00:22:59 -07:00
BingjiaWangandabing 006bd44cf9 [deepseekv3.2] fix get_k_and_s_triton kenel for 128K seqlen case bug (#19319) 
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
 2026-03-11 12:56:33 -07:00
Yoray ZackandBarak Biber 9991debde3 [Feature] Integrate Elastic NIXL-EP into SGLang (#19248) 
Signed-off-by: Barak Biber <bbiber@nvidia.com>
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Barak Biber <bbiber@nvidia.com>
 2026-03-11 17:37:43 +08:00
shubham singhalandsys-lpot-val a0d085c16d Adding correct path for module not found error while collecting test (#19778) 
Co-authored-by: sys-lpot-val <sys_lpot_val@intel.com>
 2026-03-06 16:26:16 -08:00
Xinyu ZhangandCursor b3cfad0a80 Add Ray actor support for scheduler process management (DP=1) (#17684) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-03-05 13:21:23 -08:00
Yuwei An c64274c746 Piecewise Cuda Graph set default (#16331) 2026-03-02 23:18:07 +08:00
Aurick Qiaoandhnyls2002 c6cb0c9649 [Session] Add streaming mode with SessionAwareCache fast path (#19171) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-02-27 16:31:08 -08:00
ympcMarkandUNIDY2002 43fade5f69 [4/N] (Elastic EP) Back up Expert Weights in DRAM (#17374) 
Co-authored-by: UNIDY2002 <unidy2002@outlook.com>
 2026-02-27 15:59:13 +08:00
Feng Su 3b89302277 Refactor: observability code cleanup (#17862) 
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
 2026-02-24 18:07:29 -08:00
Yuan Luoandluoyuan.luo 31c7dc9d99 [VLM] Introduce FlashInfer CUDNN Prefill as ViT Backend (#19003) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-02-24 19:49:22 +08:00
Liangsheng Yin 1f2da824dd [Benchmark] Remove re-exports from bench_serving.py (#19130) 2026-02-21 14:30:30 -08:00
Xinyuan Tong cc451671b5 [FEAT] Add Anthropic compatible API endpoint (#18630) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-02-21 19:37:38 +08:00
SoluMilken 07a24f1a38 update pre-commit config (#18860) 2026-02-16 00:18:31 +08:00
shuwenn 3299c4f9c1 [CI] feat: add early exit to wait_for_server when process dies (#18602) 2026-02-13 16:46:09 -08:00
Teng Ma df733c5ee5 [HiCache][PP] add test case for compatibility (#16395) 2026-02-09 18:03:04 -08:00
Baizhou Zhang 615a02dcd4 Revert "optimize get_topk_ragged by fusing get k and k_scale triton kernel" (#18471) 2026-02-09 16:37:19 +08:00
BingjiaWangandabing 760ae933bb optimize get_topk_ragged by fusing get k and k_scale triton kernel (#16043) 
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
 2026-02-04 19:59:41 +08:00
DiweiSunjunduGao, Pengfei
 		495290aefd enable ut test for xpu devices (#11712) 
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
 2026-02-03 11:15:14 -08:00
Alison Shao 56907cbcb1 Move deleted 8-GPU tests to test/manual/ (#18060) 2026-02-01 00:21:56 -08:00
Niko Maandcwortman-amd cbf90d70ff [PD] Support KV transfer with MORI-IO (#14626) 
Co-authored-by: cwortman-amd <cwortman@amd.com>
 2026-01-28 23:22:41 -08:00
Lianmin Zhenggithub-actions[bot]yehu-ux
 		bc6f0b5ce7 [Auto Sync] Update logits_processor.py, test_logprobs.py (20260124) (#17664) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: yehu-ux <yehu@x.ai>
 2026-01-23 17:57:41 -08:00
Even Zhou 69ac8b58f7 [NPU] [CI] temporarily disable mtp test (#17614) 2026-01-23 15:17:31 +08:00
Alison Shao 823a046e8f Add hybrid parallelism test to nightly CI (#17444) 2026-01-20 17:43:50 -08:00