|
11d03eaeef
|
runtime: Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120- #32994 (#33471)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-09 20:15:03 +08:00 |
|
|
Yuzhen Zhou
|
7120f3ee13
|
fix: support FA4 backend for GLM4.7-flash (#33436)
|
2026-08-09 20:05:38 +08:00 |
|
|
Lianmin Zheng
|
71043b9dbb
|
Revert parallel request lifecycle tracking from #32588 (#34160)
Signed-off-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-08-09 03:10:02 -07:00 |
|
|
Ke Bao
|
c500674124
|
Switch inkling per-commit test to nvfp4 (#32402)
|
2026-08-09 16:49:49 +08:00 |
|
|
Leon Gao
|
78cd60b4e3
|
[srt] Reuse batched Mamba boundary mask (#33477)
|
2026-08-09 16:47:05 +08:00 |
|
|
Mick
|
22e003580b
|
[Kimi K3] optimize: preprocess cpu-transport images on the vision owner (#33921)
|
2026-08-09 16:13:20 +08:00 |
|
|
Liangsheng Yin
|
1ebd6fab6c
|
[CI] Gate Kimi-K3 acceptance length on the GSM8K average (#34145)
|
2026-08-08 20:28:42 -07:00 |
|
|
Liangsheng Yin
|
4792ab1e90
|
[CI] Pin the rust frontend parity test to eager prefill (#34146)
|
2026-08-08 20:07:19 -07:00 |
|
|
Xiaoyu Zhang
|
38c007dfe5
|
[diffusion] FLUX.1: route the adaLN LN+modulate sites through the bit-exact fused LayerNorm+modulate kernel (H200 1024^2 lossless denoise -1.2%, e2e wall -2.9%) (#34126)
|
2026-08-09 09:52:37 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
6424fec326
|
[diffusion] Bit-exact data-movement elimination for the Wan causal VAE decoder (H200 LongLive2 704x1280x61f: decode 2.80->2.32 s lossless / 2.12->1.67 s quality=high, e2e -10.7%) (#34125)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-09 09:50:56 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
33ed5d4413
|
[diffusion] perf_logger: SYNC_STAGE_PROFILING must drain the GPU queue for stage records too (fixes 2-3x inflated DecodingStage readings) (#34124)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-09 09:49:52 +08:00 |
|
|
Wang, FangYuan
|
ba7abd4f92
|
[AMD] Support DeepSeek V4 DSpark on AMD HIP platform (#30964)
|
2026-08-08 15:22:14 -07:00 |
|
|
|
a59bb931c6
|
Fix DCP KV head mapping for GQA models (#32858)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 14:25:09 -07:00 |
|
|
Mohammad Miadh Angkad
|
c2d90db1e3
|
[CI] Add Kimi-K3 low-latency performance check (#34089)
|
2026-08-08 13:42:59 -07:00 |
|
|
Diya Peng
|
c4f018ba1d
|
[Refactor] Separate ROCm-specific DeepSeek MHA and MLA forward paths (#31531)
|
2026-08-08 13:39:36 -07:00 |
|
|
Xiaoyu Zhang
|
dc9624deb2
|
[diffusion] Clean up kernels and shared fast paths (#34085)
|
2026-08-09 00:37:00 +08:00 |
|
|
Eric ZhangandClaude Opus 5
|
f3ed82b3a8
|
[inkling] Let Anthropic thinking=disabled map to reasoning effort "none" (#33913)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 21:59:32 +08:00 |
|
|
Mick
|
db75dfe10f
|
fix: always capture default prefill CUDA graph (#33352)
|
2026-08-08 19:24:49 +08:00 |
|
|
Leon Gao
|
cfb354bcfc
|
[Bugfix] Fix batched KV free aliasing (#34067)
|
2026-08-08 03:34:44 -07:00 |
|
|
Liangsheng Yin
|
a1ca76b24b
|
[Scheduler] Unify WAR read-done gating behind shared-read boundary declarations (#34052)
|
2026-08-08 03:26:36 -07:00 |
|
|
Liangsheng Yin
|
2c0188cc78
|
[Fix] Give the piecewise CUDA graph test stub an hf_config (#34100)
|
2026-08-08 02:04:16 -07:00 |
|
|
Liangsheng YinandBaizhou Zhang
|
f6a6f5bf1e
|
[CI] Trim redundant nightly test registrations (#34070)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-08-08 01:42:46 -07:00 |
|
|
|
dd5d82bead
|
[NPU] Improve the execution efficiency and maintainability of pr‑test‑npu (#33724)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-08-08 16:42:44 +08:00 |
|
|
xdtbynd
|
e732c0a9dc
|
[UT][NPU] add unit tests for ascend_torch_native_backend and mla_preprocess (#32505)
|
2026-08-08 16:15:12 +08:00 |
|
|
DarkSharpnessandClaude Fable 5
|
4ad5bb5d9a
|
[jit_kernel] Move JIT kernels into namespace sglang (#33400)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 16:10:15 +08:00 |
|
|
Yuan Luo
|
5fdf6cd18f
|
[MoE] Single-launch moe_align for tiny batches with many experts (#32395)
|
2026-08-08 16:08:25 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
891445676c
|
[diffusion] Sana: bit-exact fused aten LayerNorm+modulate under BCG (H200 denoise -4.8%) (#34015)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 16:05:25 +08:00 |
|
|
Mick
|
d747bd052e
|
feat(vlm): auto-select cuda vmm on multi-node mnnvl (#33936)
|
2026-08-08 16:00:58 +08:00 |
|
|
Mick
|
db3898fec1
|
fix: avoid piecewise prefill graph for trtllm_mla (#32785)
|
2026-08-08 16:00:10 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
afb4f37ca5
|
[Inkling] silu_and_mul: replace helion kernels with plain Triton (#33903)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 15:00:23 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
d238e36b24
|
[Fix] Restore data_parallel_rank alias on native /generate (dp-aware gateway routing is silently dropped) (#33565)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 14:59:16 +08:00 |
|
|
Eric ZhangandClaude Opus 5
|
c69d59395b
|
[inkling] Render tool-result media instead of coercing content to str (#33898)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 14:39:19 +08:00 |
|
|
Aurick Qiao
|
6185ed8011
|
Add registered short-conv tests and backend extensions (#34045)
|
2026-08-08 14:38:03 +08:00 |
|
|
Cheng Wan
|
b61a06921e
|
moe: the shared-experts-fusion decision is a per-runner value the loader installs (#33889)
|
2026-08-07 22:42:58 -07:00 |
|
|
Cheng Wan
|
eda0ddc260
|
config: delete the dead get_server_args() bindings across the repo (#33888)
|
2026-08-07 22:41:53 -07:00 |
|
|
Cheng Wan
|
a5af27f49e
|
config: retire ServerArgs.derive; per-runner values are constructor arguments (#33887)
|
2026-08-07 22:41:09 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
5dffa06fe1
|
[diffusion] GLM-Image bit-exact fused aten LayerNorm+modulate / qk-LN (H200 30-step denoise -8.1%) (#34008)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 13:26:11 +08:00 |
|
|
Xiaoyu Zhang
|
148f15b0af
|
[diffusion] FLUX.1 fused adaLN modulate (bit-exact) + RoPE cache hoist, LN-affine folding behind quality=high (H200 e2e -3.5% lossless / -6.9% high) (#34004)
|
2026-08-08 13:07:42 +08:00 |
|
|
Ke Bao
|
633838b0ec
|
Add the 8-gpu Inkling consistency test (#34009)
|
2026-08-08 08:24:08 +08:00 |
|
|
Ke Bao
|
ce84df0fa1
|
Fix deterministic inference for Inkling (#33417)
|
2026-08-08 07:48:15 +08:00 |
|
|
Joe RowellandJimmy Shong
|
1d812865dc
|
[Laguna] fix YaRN mscale double-application in rope config (#33558)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-08-07 16:46:08 -07:00 |
|
|
Liangsheng Yin
|
c59d2b4329
|
[Fix] Judge the phase-checker device-assert test by its FAIL line, not the exit code (#34017)
|
2026-08-07 16:19:05 -07:00 |
|
|
Zhiqiang Xie
|
3dc91366ac
|
[HiCache] write_back: reclaim duplicated host copy first under host pressure (#33777)
|
2026-08-07 15:59:59 -07:00 |
|
|
Baizhou Zhang
|
eb3cc879e0
|
Install DeepEP from release wheels (#33932)
|
2026-08-07 15:38:44 -07:00 |
|
|
|
b2f9603f93
|
[bugfix] Stop/EOS inside a spec accept run beats the max_new_tokens finish (#33758)
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
|
2026-08-07 15:18:14 -07:00 |
|
|
Khoa PhamandClaude Opus 5
|
07297049e9
|
config: route DCP topology reads through get_parallel() (#33925)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-07 14:53:54 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
b3ee679467
|
[MXFP8] Use FlashInfer CUTLASS for dense GEMM on SM120, delete Triton path (#33208)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-08-07 14:30:43 -07:00 |
|
|
Dmitrii Sergeev
|
699fcdc936
|
Fix _pa_swa_prefill_lens off-by-one in FlashAttentionBackend (#33379)
|
2026-08-07 14:06:48 -07:00 |
|
|
Sam ShleiferandClaude Fable 5
|
62a28197c0
|
Autotune flashinfer extend buckets at warmup (#32556)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-07 14:06:05 -07:00 |
|
|
Zhangheng
|
1480687cff
|
[CP]: Support CP V2 Strategy for dsv4 (#33532)
|
2026-08-07 14:03:27 -07:00 |
|