minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
16,788 Commits 2 Branches 0 Tags
ae6945e112334bd3599400f933fa0cad60f60515
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Xiaoyu ZhangandClaude Opus 5 ae6945e112 [kernels] Reorganize ops/diffusion by operator domain behind a lazy facade (#35114) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-18 20:37:43 +08:00
Xiaoyu Zhang 0aa09ab40d [diffusion] Reuse bit-exact modulation fast path for LTX-2.3 (#34930) 2026-08-17 09:04:10 +08:00
Xiaoyu Zhang 41abbb0d32 [diffusion] Accelerate Cosmos3 T2I QKNorm+RoPE (#34932) 2026-08-16 20:15:32 +08:00
Xiaoyu Zhang 095ec6c997 [diffusion][kernel] Accelerate Sana BCG with bit-exact conv post-processing (#34928) 2026-08-16 20:05:57 +08:00
Xiaoyu Zhang 0761d3f3a4 [diffusion] Accelerate lossless Ideogram norm post-processing (#34931) 2026-08-16 17:20:09 +08:00
Xiaoyu Zhang b752f1e533 [diffusion] Enable breakable CUDA graphs for LTX-2.3 (#34929) 2026-08-16 17:18:43 +08:00
Xiaoyu Zhang 0c072235f4 [diffusion] Bound overlong weight lock filenames (#34825) 2026-08-15 17:20:30 +08:00
Xiaoyu Zhang 9c9a3273be [diffusion] Fix Helios denoising profiler stepping (#34826) 2026-08-14 23:21:54 +08:00
Xiaoyu Zhang 5f2a6d6422 [diffusion] Fix symbolic replicated-mode counting under torch.compile (#34824) 2026-08-14 23:20:29 +08:00
Xiaoyu ZhangandClaude Fable 5 704e512836 [GDN] Honor configured linear-attn verify backend in the kernel dispatcher (#34592) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 08:59:52 +08:00
Xiaoyu Zhang c255fbc4fe [Diffusion] Add @triple-mu as a code owner (#34748) 2026-08-14 00:37:49 +08:00
Xiaoyu Zhang ebca0bbde4 [Diffusion][ERNIE] Fuse QKNorm with full-width RoPE (#34620) 2026-08-13 23:23:21 +08:00
Xiaoyu Zhang 82f7afb881 [Diffusion] Make auto residency decisions component-scoped (#34615) 2026-08-13 23:20:55 +08:00
Xiaoyu Zhang 74c0322342 [Diffusion][FLUX.2] Fuse eager AdaLN and packed SwiGLU (#34616) 2026-08-13 19:55:53 +08:00
Xiaoyu Zhang 3c1791a7df [Diffusion][HunyuanVideo] Fuse eager QKV packing and high-quality QKNorm (#34617) 2026-08-13 19:54:00 +08:00
Xiaoyu ZhangandClaude Fable 5 a23670ddbf [diffusion] Wan2.2-TI2V: fuse per-token adaLN table add into contiguous slices + hoist rope cache (denoise -13.1% H100 / -12.6% H200, bit-exact; eager beats compile) (#34584) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-13 17:26:46 +08:00
Xiaoyu Zhang 26579d893e [Diffusion][GLM-Image] Retune QK head LayerNorm for SM103 (#34619) 2026-08-13 10:49:13 +08:00
Xiaoyu Zhang 1f008dc226 [Diffusion][LTX-2] Allocate AdaLN outputs from one contiguous slab (#34508) 2026-08-12 16:28:27 +08:00
Xiaoyu Zhang daae3acb36 [Diffusion][Z-Image] Tune native QK RMSNorm launch for SM103 (#34507) 2026-08-12 16:27:44 +08:00
Xiaoyu Zhang 4827061247 [Diffusion] Make weight-only FP8 dequant cache torch.compile-safe (#34506) 2026-08-12 16:26:31 +08:00
Xiaoyu Zhang 84ce7502cf [Diffusion][MiniMax H3] Extend exact QKNorm+RoPE rounding to SM103 (#34505) 2026-08-12 16:25:24 +08:00
Xiaoyu Zhang 45f7063335 [Diffusion] Tune QK head LayerNorm for SM103 (#34503) 2026-08-12 16:24:18 +08:00
Xiaoyu Zhang 22e4b3a81f [Diffusion] Avoid slow cuBLASLt GELU epilogue on SM120 (#34350) 2026-08-12 12:12:00 +08:00
Xiaoyu Zhang 4aff4b1822 [Diffusion] Improve bit-exact fusion fallback diagnostics (#34412) 2026-08-12 10:42:48 +08:00
Xiaoyu Zhang 3f9d184833 [Diffusion] Tune QK head LayerNorm for SM120 (#34349) 2026-08-12 10:41:54 +08:00
Xiaoyu Zhang a53d3636ce [diffusion][model] Add native SANA-Video T2V support (#32921) 2026-08-12 10:07:24 +08:00
Xiaoyu ZhangandClaude Fable 5 37c631ef23 [diffusion] Ideogram-4: fuse Qwen3-style RoPE and SwiGLU silu-mul (denoise -5.1% H100 / -4.7% H200, bit-exact) (#34314) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-12 09:19:35 +08:00
Xiaoyu Zhang b1b8ce715b [Diffusion][MiniMax H3] Fix SM120 QKNorm+RoPE rounding (#34347) 2026-08-12 09:18:16 +08:00
Xiaoyu ZhangandClaude Fable 5 546965fc72 [diffusion] LTX-2: mount the bit-exact fused modulate at the 8 bare adaLN sites (ltx23-one-stage denoise -2.8% H100 / -2.6% H200) (#34315) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-11 18:23:08 +08:00
Xiaoyu ZhangandClaude Fable 5 071f0f1e9d [diffusion] ERNIE-Image: fuse rotate-half RoPE + GELU-mul and hoist rope cos/sin (denoise -16.2% H100 / -12.7% H200, bit-exact) (#34306) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-11 18:18:37 +08:00
Xiaoyu ZhangandClaude Fable 5 ba3dc16401 [diffusion] weight-only FP8: dequantize linear weights once at first use (Ideogram-4 denoise -18.8% H200 / -7.8% H100, bit-exact) (#34305) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-11 18:15:26 +08:00
Xiaoyu ZhangandClaude Fable 5 f5f0c3ee7a [diffusion] Z-Image single-GPU BCG: fix the replay crash and make output bit-exact vs eager (#34183) (#34210) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-10 22:18:32 +08:00
Xiaoyu ZhangCursorClaude Fable 5
 		fd3036523a [diffusion] Clean up shared bitexact gates, helpers, and stale naming (#34180) 
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-10 22:14:09 +08:00
Xiaoyu ZhangandClaude Opus 4.8 441910f926 [diffusion] LTX-2 quality=high fused RMSNorm+modulate + FFN GELU epilogue (H200 ltx23-one-stage denoise 45.85->43.24 s, ~matches torch.compile) (#34172) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-08-10 09:46:17 +08:00
Xiaoyu ZhangandClaude Opus 4.8 56ef810cad [diffusion] BCG: auto-capture the default warmup resolution instead of hard-requiring --warmup-resolutions (H200 SANA denoise 0.73->0.457 s with a single flag) (#34174) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-08-10 08:37:32 +08:00
Xiaoyu Zhang f6cbdc1dd1 docs(diffusion): refresh skills for latest runtime (#34143) 2026-08-09 10:30:46 +08:00
Xiaoyu Zhang 38c007dfe5 [diffusion] FLUX.1: route the adaLN LN+modulate sites through the bit-exact fused LayerNorm+modulate kernel (H200 1024^2 lossless denoise -1.2%, e2e wall -2.9%) (#34126) 2026-08-09 09:52:37 +08:00
Xiaoyu ZhangandClaude Fable 5 6424fec326 [diffusion] Bit-exact data-movement elimination for the Wan causal VAE decoder (H200 LongLive2 704x1280x61f: decode 2.80->2.32 s lossless / 2.12->1.67 s quality=high, e2e -10.7%) (#34125) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-09 09:50:56 +08:00
Xiaoyu ZhangandClaude Fable 5 33ed5d4413 [diffusion] perf_logger: SYNC_STAGE_PROFILING must drain the GPU queue for stage records too (fixes 2-3x inflated DecodingStage readings) (#34124) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-09 09:49:52 +08:00
Xiaoyu Zhang dc9624deb2 [diffusion] Clean up kernels and shared fast paths (#34085) 2026-08-09 00:37:00 +08:00
Xiaoyu ZhangandClaude Fable 5 891445676c [diffusion] Sana: bit-exact fused aten LayerNorm+modulate under BCG (H200 denoise -4.8%) (#34015) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-08 16:05:25 +08:00
Xiaoyu ZhangandClaude Fable 5 5dffa06fe1 [diffusion] GLM-Image bit-exact fused aten LayerNorm+modulate / qk-LN (H200 30-step denoise -8.1%) (#34008) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-08 13:26:11 +08:00
Xiaoyu Zhang 148f15b0af [diffusion] FLUX.1 fused adaLN modulate (bit-exact) + RoPE cache hoist, LN-affine folding behind quality=high (H200 e2e -3.5% lossless / -6.9% high) (#34004) 2026-08-08 13:07:42 +08:00
Xiaoyu ZhangandClaude Fable 5 6c7498113f [diffusion] Enable breakable CUDA graph for SANA (H200 1024px e2e -26%, bit-exact) (#33989) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-07 23:54:39 +08:00
Xiaoyu Zhang d4be483efb [diffusion] Enable breakable CUDA graph for LTX-2 (H200 two-stage e2e 10.75 s -> 6.90 s, 1.56x) (#33885) 2026-08-07 22:29:14 +08:00
Xiaoyu ZhangandClaude Fable 5 572434e2f6 [diffusion] Z-Image bit-exact fused qk-norm (H200 Turbo 1024px e2e -6.4%) (#33886) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-07 17:03:28 +08:00
Xiaoyu ZhangandClaude Fable 5 591cfb0881 [diffusion] FLUX.2 bit-exact residual-gate fast path (H200 klein-4B 50-step denoise -1.2%) (#33823) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 22:54:40 +08:00
Xiaoyu ZhangandClaude Fable 5 dd98c9572a [diffusion] Generalize the FLUX.2 VAE decoder fast path to AutoencoderKL (Z-Image / FLUX.1) behind quality=high (#33818) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 22:53:15 +08:00
Xiaoyu ZhangandClaude Fable 5 3654740347 [diffusion] ERNIE-Image bit-exact fused RMSNorm+scale/shift (H200 1024^2 e2e 15.63 -> 15.00 s, denoise -3.3%) (#33854) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 19:58:44 +08:00
Xiaoyu ZhangandClaude Fable 5 295784723a [diffusion] Ideogram 4: fuse RMSNorm modulate/gate chains via the Z-Image Triton suite behind quality=high (H200 e2e -2.9%/-3.4%) (#33822) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 19:57:34 +08:00
Xiaoyu ZhangandClaude Fable 5 eff6a11350 [diffusion] FLUX.1 bit-exact residual-gate fast path + tanh-GELU epilogue behind quality=high (H200 e2e -1.1% lossless / -4.3% high) (#33819) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 19:56:38 +08:00
Xiaoyu ZhangandClaude Fable 5 b6876fc652 [diffusion] ERNIE-Image bit-exact residual-gate fast path (H200 1024^2 e2e 16.17 -> 15.75 s) (#33734) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 13:43:09 +08:00
Xiaoyu ZhangandClaude Fable 5 4c0a8940fa [Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 08:52:09 +08:00
Xiaoyu ZhangandMohammad Miadh Angkad ba12a16a62 [diffusion] Prefer cuDNN SDPA over FA4 for dense attention on sm_100 (B200) (#33655) 
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
 2026-08-06 08:49:10 +08:00
Xiaoyu ZhangandClaude Fable 5 3425c93666 [diffusion] Wan VAE RMSNorm+SiLU fusion behind quality=high (H200 FastWan2.2 e2e 9.611 -> 9.125 s) (#33546) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-05 21:33:35 +08:00
Xiaoyu ZhangandClaude Fable 5 a5888c956f [diffusion] Pack Ulysses Q/K/V input all-to-all into one collective + reusable a2a staging buffers (#33667) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-05 19:15:46 +08:00
Xiaoyu ZhangandClaude Fable 5 95d0e57e83 [diffusion] Fuse DiT FFN tanh-GELU into up-proj GEMM (cublasLt epilogue) behind quality=high (Qwen-Image 1024^2 denoise 12.36 -> 12.05 s on H200) (#33536) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-04 23:49:43 +08:00
Xiaoyu Zhang 0d0c7d853f [diffusion] FLUX.2 VAE decoder fast path behind quality=high (H200: 1024^2 97.6->29.2 ms, 2048^2 437.2->168.5 ms) (#33451) 2026-08-04 23:48:19 +08:00
Xiaoyu ZhangandClaude Fable 5 c6f2a9c1d4 [diffusion] Restrict request-level quality to two validated tiers: lossless (default) and high (#33453) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-04 11:43:16 +08:00
Xiaoyu Zhang f829fb3ff7 [diffusion] Fix component accuracy topology reuse (#33317) 2026-08-04 08:35:03 +08:00
Xiaoyu ZhangandClaude Fable 5 4ef1660cd8 [Docs] MiniMax-H3: add measured H200 Ulysses4 vs TP2+Ulysses2 topology data (#33398) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-03 12:54:29 -07:00
Xiaoyu Zhang b64fd800d4 docs(diffusion): update skills for MiniMax-H3 (#33282) 2026-08-03 12:44:01 +08:00
Xiaoyu ZhangClaude Opus 5hnyls2002zhangxiaolei
 		fb207b72b0 feat(kernels): port standalone Kimi K3 kernels (#32890) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: zhangxiaolei <zhangxiaolei.666@bytedance.com>
 2026-08-01 13:26:47 +08:00
Xiaoyu Zhang c5bd3d7dce [diffusion][benchmark] Add reproducible request-manifest offline benchmark (#32917) 2026-07-30 22:11:18 +08:00
Xiaoyu Zhang 7784ac8f91 [diffusion][docs] Fix Cosmos3 model sizes (#32916) 2026-07-30 22:10:23 +08:00
Xiaoyu Zhang 2e9c82b359 [Kernel] Remove unreachable AOT headers (#32842) 2026-07-30 22:08:57 +08:00
Xiaoyu Zhang 1d9c292547 [Kernel] Add inventory guards and clean benchmark layout (#32788) 2026-07-30 09:03:24 +08:00
Xiaoyu Zhang 0ebbe43dbb fix(diffusion): size VSA top-k from padded blocks (#32695) 2026-07-29 21:58:41 +08:00
Xiaoyu Zhang 4f5b50c576 perf(diffusion): decode Wan VAE in BF16 (#32697) 2026-07-29 21:57:50 +08:00
Xiaoyu Zhang 917e900d4d feat(diffusion): add regional torch compile (#32696) 2026-07-29 21:57:05 +08:00
Xiaoyu ZhangandClaude Fable 5 8742a1a0f8 Add a benchmark script for the HPC-Ops bf16xfp32 router GEMM (#32642) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-29 18:17:08 +08:00
Xiaoyu Zhang c32c4ef79c [Kernel] Move sgl-kernel under sglang.kernels.aot (#32648) 2026-07-29 17:25:00 +08:00
Xiaoyu Zhang c9947b087b Enable multimodal prefill BCG for VL and audio models (#30872) 2026-07-29 06:47:40 +08:00
Xiaoyu Zhang 7778dd23ea [diffusion] refactor: remove stale kernels and dead code (#32651) 2026-07-29 06:23:23 +08:00
Xiaoyu Zhang 9cffc2ba52 [Kernel] Remove unused implementations and stale registry entries (#32636) 2026-07-28 18:12:10 +08:00
Xiaoyu ZhangClaude Fable 5Halcyon
 		8d6549bc40 [Attention Backend] Extend hpc_ops dynamic-scheduled decode to bf16 (#32304) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
 2026-07-27 21:31:04 +08:00
Xiaoyu ZhangClaude Fable 5Halcyon
 		3d91a569ce [MoE Backend] Add HPC-Ops FP8 MoE runner backend (#30541) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
 2026-07-24 19:46:11 +08:00
Xiaoyu ZhangHalcyonClaude Fable 5
 		841fa293b5 [Fix] Reject online weight updates while the HPC-Ops router GEMM split cache is active (#31943) 
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-24 19:30:13 +08:00
Xiaoyu ZhangandClaude Fable 5 d4a0dfbc31 [Fix] Two root causes of the H100 deepep TBO CI break: scale-tensor use-after-free + missing non-finite quant sanitization (#32188) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-24 07:29:28 +08:00
Xiaoyu ZhangandClaude Opus 4.8 62aa85d9aa [Kernel] Sweep missed dedicated kernels into kernels.ops (moe/quant siblings + dspark) (RFC #29630) (#32160) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-23 17:07:16 +08:00
Xiaoyu ZhangandClaude Opus 4.8 11b0e5c5ad [Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630) (#32148) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-23 13:47:02 +08:00
Xiaoyu ZhangandClaude Opus 4.8 2d1a7be8c4 [Kernel] Reclassify kernel tests by ops group + move helpers out of the package (RFC #29630) (#32128) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-23 12:18:27 +08:00
Xiaoyu ZhangandClaude Opus 4.8 99f636a86f [Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels (#32072) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-23 08:35:09 +08:00
Xiaoyu ZhangClaude Fable 5Halcyon
 		0a6d1930c3 [Attention Backend] Add HPC-Ops attention backend (#30540) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
 2026-07-22 22:06:22 +08:00
Xiaoyu ZhangandClaude Opus 4.8 74338e94f1 [Kernel] Phase 4 batch-3: migrate tangled JIT subsystems + new groups into kernels.ops (RFC #29630) (#32045) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-22 21:15:03 +08:00
Xiaoyu ZhangandClaude Opus 4.8 977ea336cd [Kernel] Phase 4 batch-2: migrate JIT operator groups into kernels.ops (no shims) (RFC #29630) (#32015) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-22 17:49:51 +08:00
Xiaoyu ZhangandClaude Opus 4.8 246b3c3eaf [Kernel] Phase 3+4: move JIT infra + operator groups into sglang.kernels (RFC #29630) (#31666) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-22 11:28:27 +08:00
Xiaoyu Zhang 075bd97952 [Benchmark] Remove obsolete auto-benchmark remnants (#31941) 2026-07-21 20:44:52 +08:00
Xiaoyu ZhangClaude Fable 5Halcyon
 		e4eea7ce2f Optimize LongCat-Flash router GEMM with the HPC-Ops bf16xfp32 kernel (#30247) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
 2026-07-21 20:05:17 +08:00
Xiaoyu Zhang 829e9ce9d5 Lower AutoRound quantization MMLU threshold (#31748) 2026-07-20 13:40:48 +08:00
Xiaoyu ZhangandClaude Opus 4.8 216b750c8f [Kernel] Sweep decoupled scattered kernels into sglang.kernels.ops (RFC #29630) (#31582) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-18 19:07:07 +08:00
Xiaoyu ZhangandClaude Opus 4.8 619609aa5a [Kernel] Simplify sglang.kernels tests to idiomatic pytest style (RFC #29630) (#31546) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 15:06:26 +08:00
Xiaoyu ZhangandClaude Opus 4.8 1ac1ffea0c [Kernel] Fill non-CUDA coverage: HIP (aiter/rocm-triton) + Ascend NPU backends (RFC #29630) (#31307) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 14:05:35 +08:00
Xiaoyu ZhangandClaude Opus 4.8 8432eafd3d [Kernel] Decouple KernelBackend from device + device-based CapabilityRequirement (RFC #29630) (#31292) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 10:35:34 +08:00
Xiaoyu Zhang e73f323464 [JIT] Reduce MoE fused gate CI test sweep (#31400) 2026-07-16 14:42:45 +08:00
Xiaoyu ZhangandClaude Fable 5 22453ca63c docker: build HPC-Ops into the GPU image (#31390) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-16 11:07:01 +08:00
Xiaoyu ZhangandClaude Fable 5 4aadf94146 [Kernel] Relocate vendored fla and mamba kernel trees to sglang.kernels (RFC #29630, Phase 2.5, 7/7) (#30795) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-15 12:52:15 +08:00
Xiaoyu ZhangandClaude Fable 5 c00131ebaa [Kernel] Migrate linear-attention, MiniMax-sparse and diffusion kernels to sglang.kernels (RFC #29630, Phase 2.5, 6/7) (#30793) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-15 11:21:36 +08:00
Xiaoyu ZhangandClaude Fable 5 ba5be86d42 [Kernel] Migrate DSA + DSV4 attention kernels to sglang.kernels (RFC #29630, Phase 2.5, 5/7) (#30792) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-15 11:11:22 +08:00
Xiaoyu ZhangandClaude Fable 5 ee000f6734 [CI] Fix SGLANG_JIT_KERNEL_RUN_FULL_TESTS never activating the nightly full jit-kernel sweep (#31042) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-14 17:32:29 +08:00