minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
18,675 Commits 4 Branches 0 Tags
main
Commit Graph
18675 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yuxuan Zhang d040333c95 [Bug Fix] missing index/KV transfer for MTP layer in NSA disaggregation (#23539) 2026-04-30 11:55:45 +08:00
YC Yen-Ching Tseng 9e68c8527e [AMD] Update AMD Nightly Test checkout mechanism (#24112) 2026-04-30 11:36:18 +08:00
yudian0504hzh0425yizhang2077
 		2d2be5d7b2 [PD][Bugfix] fix mamba cache capping (#22462) 
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: yizhang2077 <1109276519@qq.com>
 2026-04-30 10:57:55 +08:00
Chi McIsaac fdfe53e872 [misc] update CI_PERMISSIONS.json (#24062) 2026-04-30 10:24:22 +08:00
MingxuZhandMa Mingfei 62136073f9 pin the version of xgrammar to v0.1.32 (#24010) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-04-30 10:13:08 +08:00
heziiop 3553fd0322 [NPU] add split_qkv_tp_rmsnorm_rope ops for minimax2 & fix eagle3 hidden states capture in dp attn mode (#23190) 2026-04-30 08:51:22 +08:00
Lianmin Zheng e60c60eff0 [SWA] Fix missing mamba_indices parameter in cpu copy interface (#24026) 2026-04-29 17:33:38 -07:00
Qiaolin Yu 2bbd30a27a relax the threshold in test_step3p5_flash_chain_mtp (#24105) 2026-04-29 16:53:35 -07:00
Qiaolin Yu ea794deefc [misc] fix lint in main branch (#24095) 2026-04-29 15:01:35 -07:00
Kangyan-ZhouandClaude Opus 4.7 6575aea128 [CI] Fix black formatting on main (unblocks PR #21247 lint) (#24093) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-29 14:59:17 -07:00
Jimmy Shong 3d31ac2672 [Fix] FP8 Qwen3-Next quant error by removing fallback fused shards (#23973) 2026-04-29 17:33:47 -04:00
jsheng_LinkedinandClaude Opus 4.7 850021378a [Score API] Hoist query placeholder scan and specialize PositionalEmbeds stacking (#23513) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-29 13:51:53 -07:00
Qiaolin Yu 79dbfe4505 Use spec v2 by default (#21062) 2026-04-29 13:40:42 -07:00
Alex NailsandClaude Opus 4.7 c3ab5bec7d ci: consolidate rust + protoc install across workflows (#23700) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-29 13:39:02 -07:00
Baizhou Zhang b3ead32d3c [minor] Remove incorrect note after supporting w4a16 moe for DeepSeek V4 (#24035) 2026-04-29 13:26:13 -07:00
Zhongdongming Dai 7389743d85 feat: Support modelexpress p2p RDMA transfer (#23105) 2026-04-29 12:57:40 -07:00
jsheng_Linkedin db84a8ebbb [Model] Qwen3ForPooledOutput: forward get_input_embeddings to inner model (#23434) 2026-04-29 12:25:06 -07:00
Chang Min BarkR0CKSTARAlex Nails
 		3272af2f00 [Apple Silicon] [MLX] MLX decode partial overlap scheduling for generation (async eval) (#22416) 
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
 2026-04-29 12:21:14 -07:00
Kangyan-ZhouandClaude Opus 4.7 d4040e7010 [CI] Broaden stage-b-test-1-gpu-large runner pool to H100 + H200 (#24080) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-29 12:18:10 -07:00
Yihao Wang 903e46d848 [Bench] fix bench_hf.py KeyError + reduce print spam + add --limit (#24079) 2026-04-29 11:43:37 -07:00
Xinyuan Tong 1376761841 fix(moe): repair dead import in fused_moe_native after MoE refactor (#24069) 2026-04-29 11:14:52 -07:00
Jeongho Shin 530b497a48 [BugFix] correct host leaf status check from evicted to backuped (#23537) 2026-04-29 10:26:00 -07:00
shuwennandClaude Opus 4.7 03147f66b8 ci: add /rerun-group to rerun all registered tests in a group (#24023) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-29 10:24:16 -07:00
Xinyuan Tong 4cf109bbd1 debug followup (#24058) 2026-04-29 23:03:27 +08:00
Qi Yuhangandgemini-code-assist[bot] 3f7c95d6cc [JIT Kernel][1/2]Migrate MXFP8 Group GEMM & Quant into JIT (#23833) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-29 22:50:09 +08:00
Mick eeb7b5c433 [diffusion] fix: align encoder of flux klein with official (#24008) 2026-04-29 22:42:16 +08:00
YC Yen-Ching Tsengandbingxche 155e333039 [AMD] Update AMD CI workflow concurrency group (#24065) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-29 22:39:18 +08:00
Mick e5c2a9b6cf [diffusion] fix: improve LTX2.3 reference accuracy controls (#24022) 2026-04-29 21:39:27 +08:00
Xinyuan Tong 1279ae0787 Bugfix (#24027) 2026-04-29 21:13:51 +08:00
AndyLi429 4c1eefca4f [NPU] ascend backend support qwen3 moe attention cp (#21685) 2026-04-29 19:25:17 +08:00
Zheng Wengang ae0c036c24 [BugFix][EPD] fix embedding req_id transfer error (#23481) 2026-04-29 18:56:03 +08:00
jacky.chengandBingxu Chen 180bb2624f [AMD] Fix CI RuntimeError: opentelemetry package is not installed (#23940) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-04-29 18:02:44 +08:00
hhwxw d9270b8c6a fix(moe): relocate orphan tuned configs after #23019 (#24004) 2026-04-29 02:00:13 -07:00
Brian 6c7b242181 mimo v2.5 pro sglang-jax cookbook (#23936) 2026-04-29 16:58:41 +08:00
Sam (Kesen Li) 73e93bebd6 [1/4] NVFP4 KV cache: quantization strategy abstraction and kernel (#21954) 2026-04-29 01:45:48 -07:00
danielafrimi 8327270c72 [Kernel] Support FlashInfer TRTLLM-Gen fused MoE for non-gated FP4 & FP8 (Nemotron) (#21321) 2026-04-29 01:28:21 -07:00
Liangsheng Yin bd448e51bd [Spec] Split accept_length into num_accepted_drafts and num_accepted_tokens (#23962) 2026-04-29 00:02:22 -07:00
Xinyuan Tong 832b4f59ed [Bench] fix MMMU answer-extraction regex dropping multi-line responses (#23864) 2026-04-29 14:48:49 +08:00
shuwenn 2c41ef4c93 [HiCache] feat: add draft KV cache backing for L2/L3 (#21125) 2026-04-28 23:47:31 -07:00
Mick 71d2227a78 [diffusion] CI: update ground truth with official output (#23714) 2026-04-29 13:51:31 +08:00
JieTang66andJieTang 5a94088178 Fix typo: page_first_kv_spilt -> page_first_kv_split (#23983) 
Co-authored-by: JieTang <tangjie66@huawei.com>
 2026-04-29 12:08:05 +08:00
ZeyuanChen2000 23cfa9e4c8 [NPU] fix rope_theta get error for baichuan2-13b-chat model (#21543) 2026-04-29 12:01:03 +08:00
Yuhao Yang b437f6be48 model: Nemotron-omni-v3-alias (#23857) 2026-04-29 11:08:23 +08:00
Qiaolin Yu f57ec8d6ef [spec decoding] add extra attribute 'spec_hidden_size' (#23890) 2026-04-28 19:54:50 -07:00
Lianmin Zheng 2a771a40ac Add engine_type label to tokenizer manager metrics (#23978) 2026-04-28 19:52:58 -07:00
Lianmin Zheng d66eb3a91b docs: update contribution guide with coding style guidelines (#23977) 2026-04-28 19:51:58 -07:00
Rahul Vijayaraghavan 1aee04e7df [XPU] Support apply_router_weight_on_input for Llama4 for fused_experts (#22654) 
merge this one as it is xpu only change.
 2026-04-29 10:44:48 +08:00
ccullen-cert 1e14bd6f36 Fix for CVE-2026-5760 (#23660) 2026-04-28 19:39:44 -07:00
Baizhou Zhang 4e885baa9b docs(cookbook): add H200 (FP4) deployment option for DeepSeek-V4 (#23980) 2026-04-28 19:38:53 -07:00
Kangyan-ZhouandClaude Opus 4.7 feec1ac7f9 ci: clean up stale-CUDA mooncake variant in install_extra_deps (#23960) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-28 19:32:38 -07:00