minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
18,694 Commits 3 Branches 0 Tags
dsv41-pd
Commit Graph
5089 Commits
Author SHA1 Message Date
guzekai01 716a6bf10c feat(humming): support native W4AFP8 checkpoint schemas (#32033) 2026-08-24 18:59:27 +08:00
guzekai01 21258b7a35 feat(humming): FP8 DeepEP dispatch for humming MoE backend (#31429) 2026-08-24 18:59:07 +08:00
Xiaoyu Zhang 46b92b22e2 [diffusion] Accelerate LingBot Video RMSNorm in quality=high (#35969) 2026-08-24 18:02:00 +08:00
caupheAlex NailsClaude Opus 5
 		092d85eb87 [Feature] Add MiniCPM-SALA support (#30360) 
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-24 02:25:16 -07:00
SuperSong d251fa2453 perf(unified-memory): batch lazy-compaction mapping lookup (#34066) 2026-08-24 02:14:45 -07:00
gaopengffandMa Mingfei 317da0964e [Intel XPU] support prefill only models for xpu (#35072) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-08-24 16:25:47 +08:00
Alex NailsandClaude Opus 5 666b08b4a5 [ROCm] Extend the gfx950 extend-attention tile to head_dim <= 128: -43% kernel, -14% TTFT, bit-identical (#34461) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-24 00:29:39 -07:00
ming_wang 97b176e64c Support streaming session on NPU (#32597) 2026-08-24 14:07:44 +08:00
Xiaoyu Zhang 6d40b8aebf [diffusion] Fix Hunyuan QKV pack indexing at production video shapes (#36009) 2026-08-24 13:39:26 +08:00
Yuan Luoandluoyuan.luo 77940dec80 [MoE] Gather the cutlass MoE activation and its scales in one launch (#34915) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-08-24 13:37:14 +08:00
Lianmin Zheng b498efce52 chore: move cuda_vmm_utils.py under srt/utils/ (#36053) 2026-08-23 21:47:29 -07:00
gaopengffandMa Mingfei 56834422a1 [Intel XPU] Add xpu pass for biased_topk and hash_topk (#33323) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-08-24 12:18:22 +08:00
Chunyuan WU 1daa94a069 [CPU] Fix NUMA/core binding for DP ranks (#32856) 2026-08-24 12:15:38 +08:00
Aurick QiaoandYuwei An 3e30649064 [Fix] Harden FlashAttention CUDA graph metadata bounds (#35454) 
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
 2026-08-23 21:11:46 -07:00
Xia Weiwen 5b5b29d4e2 [XPU] Use a fused GDN kernel from sgl-kernel for Qwen3.5 (#33354) 2026-08-24 12:07:50 +08:00
Xiaoyu Zhang 8dcfb3b5e7 [diffusion] Fuse LongCat-Image QKNorm and interleaved RoPE (#35995) 2026-08-24 12:07:26 +08:00
Mick 7a7b655ddf [quantization] share bounded post-load device staging (#35180) 2026-08-24 11:48:30 +08:00
Alison Shao 0c1e9bda57 [OpenAI] Drop empty assistant turns for mistral_common tokenizers (#35915) 
mistral_common rejects an assistant turn carrying neither content nor tool calls, while other chat templates ignore it, so an OpenAI-compatible request that works elsewhere failed on Mistral models. Drop those turns before templating; turns with tool_calls, multimodal content, or real text are untouched, and a trailing assistant message is already consumed upstream as the continue_final_message prefix.
 2026-08-23 20:07:17 -07:00
Xun Sunandsiyu a90d770c40 [Weight Cache] Support static DP/EP layouts (#33684) 
Co-authored-by: siyu <liusy58@linux.alibaba.com>
 2026-08-23 19:57:52 -07:00
junduZhang, MingxuMingxuZhCopilot Autofix powered by AIClaude
 		514b997e6c Register CPU CI for 17 e2e tests and partition xeon base-c suite (#35227) 
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-08-24 10:49:38 +08:00
YangKai0616andgemini-code-assist[bot] fbdec2855a [XPU] Support INT4 dense linear (AWQ/GPTQ) for XPU (#30236) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-08-24 10:41:59 +08:00
YanbingJiang fd73d4b019 [CPU] Add graph register for fused_sigmoid_mul_cpu, fused_qk_gemma_rmsnorm (#35506) 2026-08-24 10:18:57 +08:00
Kalyan Kumarandvshekhawat-hlab 4c02584773 Add intel_xpu to DETERMINISTIC_ATTENTION_BACKEND_CHOICES (#29143) 
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai>
 2026-08-24 09:47:34 +08:00
Xiaoyu Zhang e129fe21e5 [diffusion] Flatten Wan VAE RMSNorm row addressing (#35981) 2026-08-24 08:57:54 +08:00
Michael 20064623ab [AMD][CI] Add the Qwen3.8 MXFP4 MI35x nightly (#35383) 2026-08-23 17:17:10 -07:00
Sahithi ChigurupatiandMohammad Miadh Angkad 44db041700 [NVIDIA] Fix SM107 MXFP8 activation prep (#35405) 
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
 2026-08-23 18:17:03 +08:00
Zetian Li - ikunClaudeXinyuan Tong
 		27aa48bca1 [Fix] lfm2 detector: recover tool calls dropped by common model-outpu… (#34237) 
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-08-23 18:09:43 +08:00
Cheng WanandClaude Opus 5 340391a297 config: publish before the launcher reads effective configuration (#35910) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-23 01:20:20 -07:00
Cheng WanandClaude Opus 5 a43592dce5 config: pin two orderings resolution relies on (#35909) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-23 01:19:44 -07:00
Cheng WanandClaude Opus 5 362c2ee849 config: borrowed-record reads follow the config bags (#35908) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-23 01:19:20 -07:00
Cheng WanandClaude Opus 5 64aa859da2 config: constructing a config no longer resolves it (#35907) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-23 01:18:53 -07:00
Cheng WanandClaude Opus 5 4bc79a1b49 config: project the config bags from the resolution result (#35906) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-23 01:18:24 -07:00
Cheng WanandClaude Opus 5 0e22777572 config: record resolution writes in a declaration stash (#35905) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-23 01:17:27 -07:00
Cheng Wan 6218d6ce3f config: a defensive publish must not re-project over a live process (#35904) 2026-08-23 01:16:39 -07:00
Xinyi Song edd675cecf [AMD] Add Radix-4 MoE top-k router kernel for Kimi-K3 routing (#34490) 2026-08-22 23:57:35 -07:00
Chungman LeeandMohammad Miadh Angkad 7f30d66045 [Kimi-K3] Fix "wrong grids" crash in DP-sharded vision preprocessing (#35305) 
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
 2026-08-23 09:20:51 +08:00
Hồ Sỹ Thế eec794bce0 [AMD][Spec] Fix aiter GQA packing + split-KV routing in NEXTN spec attention (verify & draft_extend) (#30105) 2026-08-22 14:22:43 -07:00
karverma-amd1am9trashHAI
 		d315eb7250 [AMD] DeepSeek-V4: add aiter fused mHC post+pre with cross-layer boundary dispatch (#32577) 
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
 2026-08-22 07:34:57 -07:00
Shangming Cai 3c69a4c744 fix(test): unbreak test_kv_transfer_replica_metric after #35950 (#35974) 2026-08-22 19:23:46 +08:00
siyuandliusy58 cb10ca16dd [FEAT] Weight Daemon abstraction (#33279) 
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
 2026-08-22 02:13:46 -07:00
Mohammad Miadh Angkad 90354326c7 [VLM] Split Pixtral multi-image features before the CUDA IPC wrap (#35463) 2026-08-22 15:17:55 +08:00
Jianfei Wangandmiraclezqc af39ad9349 [Model] Complete dots.note.omni support with native encoders, video preprocessing, and MTP decoding (#33829) 
Co-authored-by: miraclezqc <dysania@pku.edu.cn>
 2026-08-22 14:19:14 +08:00
Xiaoyu Zhang 83e9ece672 [diffusion] Fuse SANA-Video interleaved RoPE (#35695) 2026-08-22 12:56:45 +08:00
Mohammad Miadh AngkadandMohammad Angkad 3e096629cf [CI] Re-enable B300 jobs (#35607) 
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
 2026-08-22 12:34:21 +08:00
Shangming Cai ac179eec11 fix(disagg): PD transfer-failure injection was silently inert (#35890) 2026-08-22 11:51:16 +08:00
Zhiqiang Xie 0db2bdfec5 Fix buffer-mode HiCache load-back ownership races; add optional prefetch anchor lock (#35769) 
Signed-off-by: Zhiqiang Xie <zqx@meta.com>
 2026-08-21 20:20:36 -07:00
Alec SandAlec Solder fbafd1b123 Add sampling observer auxiliary output hooks (#35747) 
Co-authored-by: Alec Solder <alecs@fb.com>
 2026-08-21 19:28:18 -07:00
Ke Bao 5662c03363 Support CPU offload for mxfp8 KV cache (#35888) 2026-08-22 10:19:06 +08:00
R0CKSTARandAlex Nails d90318b3e2 [MLX] Upgrade to Torch 2.13/MLX 0.32+ and redesign the Torch-MLX tensor bridge (#32984) 
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
 2026-08-21 18:51:42 -07:00
Baizhou Zhang 3b5909de0e [DeepSeek V4] Add W4A4 MegaMoE server flag (#35918) 2026-08-21 18:44:18 -07:00