minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,339 Commits 2 Branches 0 Tags
b95324d19c823a2b53f6ebc1a00b74c53dfd866e
Commit Graph
11339 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ke Bao b95324d19c Update test coverage report (#22190) 2026-04-06 20:59:38 +08:00
Ke Bao 9ca2ae1c6c Update test skills and guide (#22189) 2026-04-06 20:30:25 +08:00
Aurick Qiao 3178f3959f Align incremental streaming logprobs with streamed output tokens (#21583) 2026-04-06 00:30:02 -07:00
Khoa Pham 12272b6791 [Spec][Ngram] 6/N: Load an external corpus and construct a Suffix Automaton (#21425) 2026-04-06 00:11:14 -07:00
Mohammad Miadh Angkad b311db2e49 [Doc] Fix and improve DeepSeek V3.2/GLM-5 documentation (#22179) 2026-04-05 23:26:42 -07:00
Liangsheng Yin 6de2ff2a80 [Spec][Ngram] Followup fixes for MatchState incremental advance (#22180) 2026-04-05 23:04:28 -07:00
YAMYandShangming Cai dc125afffb Add staging buffer CI test and documentation for heterogeneous TP (#21921) 
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-04-06 14:00:20 +08:00
Khoa Pham b2008bf9e0 [Spec][Ngram] 5/N: Store and advance anchor match state across decode steps (#21243) 2026-04-05 22:21:05 -07:00
Mick 82c41a2d9e [diffusion] model: support LTX2.3 (#22111) 2026-04-06 12:26:30 +08:00
Qiaolin Yu f407461ec8 Tiny fix trtllm_fp8_per_tensor_scale_moe_wrapper router_logits dtype (#22006) 2026-04-05 21:11:45 -07:00
Ke Bao c4240218cb Fix ut module importing (#22176) 2026-04-06 11:53:58 +08:00
Lianmin Zheng e835601fb7 Cache gfx95 quant format detection in DeepseekV2DecoderLayer (#22143) 2026-04-05 20:20:54 -07:00
Bi Xueandyilian49 52801ff20c [sgl] two potential spec_v2 bug fixes (#21589) 
Co-authored-by: yilian49 <yilian49@users.noreply.github.com>
 2026-04-05 19:41:43 -07:00
Lidang Jiang 682ddf6416 [CI] Add unit tests for srt/utils/auth.py (#21400) 2026-04-06 10:30:46 +08:00
Lidang Jiang 30f5b87608 [CI] Add unit tests for function_call detectors (hermes, llama32, mistral) (#21399) 2026-04-06 10:29:55 +08:00
ROSINE HE 8d8aca8f26 [Test] Add unit tests for srt/tokenizer/tiktoken_tokenizer (#21107) 2026-04-06 10:23:19 +08:00
Prozac614anddaiweitao 2f00e42555 [diffusion] CI: apply diffusers backend in lora case (#22157) 
Co-authored-by: daiweitao <dwti614707404@163.com>
 2026-04-06 10:14:35 +08:00
Zhiqiang Xiehuangtingwei9988hzh0425
 		41c7c97ff3 fix hisparse LRU policy (#22170) 
Co-authored-by: huangtingwei9988 <huangtingwei9988@users.noreply.github.com>
Co-authored-by: hzh0425 <hzh0425@users.noreply.github.com>
 2026-04-05 18:47:58 -07:00
Kangyan-ZhouClaude Opus 4.6Baizhou Zhang
 		93109cc89b [Fix] Fix setuptools-scm version resolution for rc tags (#22165) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-04-05 16:55:32 -07:00
Zhiqiang Xiehuangtingwei9988hzh0425
 		30ba1f78b0 Hisparse Minor Fix (#22131) 
Co-authored-by: huangtingwei9988 <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: hzh0425 <58988019+hzh0425@users.noreply.github.com>
 2026-04-05 16:15:47 -07:00
Baizhou Zhang 20ee59bcfc [Misc] Remove unused cu13 docker release workflow (#22167) 2026-04-05 16:01:02 -07:00
Kangyan-ZhouandClaude Opus 4.6 596c34ee04 Update ci_auto_bisect.py to have streak 1 so that all failures will b… (#22161) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-05 10:39:19 -07:00
Shangming Cai 75ab75d027 Fix create_grammar_backend test calls with think_end_id (#22158) 2026-04-06 00:54:35 +08:00
Kangyan-ZhouClaude Opus 4.6Baizhou Zhang
 		5dd2c243eb fix: TRT-LLM MHA CUDA illegal address with EAGLE v2 + DP attention (#21649) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-04-05 09:41:14 -07:00
Baizhou Zhang c5fa364b80 [Hotfix] Fix router gemm on sm103 (#22134) 2026-04-05 09:33:14 -07:00
Zhangheng f6c9072e42 [SpecV2]: Reopen kl accuracy test for qwen3 + SpecV2 (#22104) 2026-04-05 23:26:40 +08:00
Zhangheng晟海
 		51b276de74 [BugFix][RadixTree]: Fix backup invariant violation in Hi-MambaRadixTree (#22062) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: linjianyu77@foxmail.com
 2026-04-05 23:19:50 +08:00
Shangming Cai dccb11881f [PD] Fix staging warmup for GQA prefill decode different tp (#22153) 2026-04-05 23:13:06 +08:00
Liangsheng YinandShangming Cai 3a4f4cbc52 DEBUG: reproduce flaky test_load_weights_from_remote_instance (#22150) 
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-04-05 22:46:36 +08:00
Liangsheng Yin df9c831ab8 Unify think_end_id to model_config as single source of truth (#22148) 2026-04-05 03:35:38 -07:00
Liangsheng Yin aeff9fb7c1 Add dump_metric to MMMU, lm-eval, and NeMo Skills eval paths (#22147) 2026-04-05 03:23:52 -07:00
Liangsheng Yin cd2d45e220 Isolate spec V1 path in decode post-processing (#22146) 2026-04-05 03:16:56 -07:00
Baizhou Zhang 106baedbfb [Doc] Update GLM-5 instructions in sglang documentation (#21716) 2026-04-05 03:13:07 -07:00
R0CKSTAR 10b18b8b29 [diffusion] Add is_float64_supported to Platform (#22112) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-04-05 18:12:28 +08:00
iLeGendandBaizhou Zhang 5a35316417 Enable IndexCache for DeepSeek V3.2 (#21405) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-04-05 02:45:58 -07:00
Baizhou Zhang 088203454b [Fix] Fix nightly tests (#22140) 2026-04-05 02:26:42 -07:00
Liangsheng Yin bd6a585605 Consolidate reasoning tests into test/registered/reasoning/ (#22139) 2026-04-05 01:09:11 -07:00
Yuhao YangandMick 2b119ba388 [diffusion] fix: fix accuracy for flux series (#22059) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-04-05 16:03:17 +08:00
Xiancheng Mengandmengxiancheng03 71544f0341 [model] support voxtral (speech-to-text) (#21635) 
Co-authored-by: mengxiancheng03 <mengxiancheng03@kuaishou.com>
 2026-04-05 15:46:30 +08:00
Liangsheng Yin 904bb476d8 Migrate reasoning_tokens tests to existing server fixtures (#22102) 2026-04-05 00:30:57 -07:00
Liangsheng Yin bb9e058f5b Add failfast flag to rerun-test workflow (#22141) 2026-04-05 00:24:50 -07:00
Kangyan-Zhou edee9ae929 Update ci_auto_bisect.py to use correct model (#22142) 2026-04-04 23:57:52 -07:00
Baizhou Zhang 723ed6c3c4 [CI]Temporary ban auto benchmark tool test (#22138) 2026-04-04 23:18:19 -07:00
Liangsheng Yin 675100b53a Remove flaky TestToolChoiceLfm2Moe from test_tool_choice (#22137) 2026-04-04 22:53:11 -07:00
RoyWangandRoyWang dd49127fe6 [AMD]: Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5… (#21213) 
Co-authored-by: RoyWang <RoyWang@amd.com>
 2026-04-04 22:13:29 -07:00
Kangyan-ZhouandClaude Opus 4.6 8cbeacd783 feat: CI auto-bisect workflow for automated regression analysis (#22119) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-04 18:58:18 -07:00
Ricardo-M-LyujClaude Opus 4.6
 		70658bfeb5 fix: add missing f-string prefixes in warning and assert messages (#22067) 
Co-authored-by: yuj <yuj@ztjzsoft.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-04 17:20:16 -07:00
MickandClaude Opus 4.6 efee62efa6 [diffusion] CI: improve diffusion comparison benchmark setting for realistic perf and auto-discover ut (#22086) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-04 23:20:37 +08:00
Xiaoyu Zhang 0f0f004f1f [Benchmark] Add auto benchmark tool with YAML-driven server flag search and canonical dataset format (#21736) 2026-04-04 21:46:58 +08:00
Xiaoyu Zhang da25b471e3 Align diffusion nightly presets and broaden skill discovery (#22099) 2026-04-04 21:43:52 +08:00