|
a59bb931c6
|
Fix DCP KV head mapping for GQA models (#32858)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 14:25:09 -07:00 |
|
|
Mohammad Miadh Angkad
|
c2d90db1e3
|
[CI] Add Kimi-K3 low-latency performance check (#34089)
|
2026-08-08 13:42:59 -07:00 |
|
|
Diya Peng
|
c4f018ba1d
|
[Refactor] Separate ROCm-specific DeepSeek MHA and MLA forward paths (#31531)
|
2026-08-08 13:39:36 -07:00 |
|
|
Brayden Zhong
|
3fbb5330c7
|
Fix the router GEMM inaccuracy when using _front_w in Kimi-K3 (#33764)
|
2026-08-08 19:23:40 +00:00 |
|
|
Xiaoyu Zhang
|
dc9624deb2
|
[diffusion] Clean up kernels and shared fast paths (#34085)
|
2026-08-09 00:37:00 +08:00 |
|
|
Mohammad Miadh AngkadandBBuf
|
ec5199b906
|
[jit_kernel] Fix missing JIT kernel namespaces (#34106)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-08-08 22:15:05 +08:00 |
|
|
Eric ZhangandClaude Opus 5
|
f3ed82b3a8
|
[inkling] Let Anthropic thinking=disabled map to reasoning effort "none" (#33913)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 21:59:32 +08:00 |
|
|
|
548ff545c5
|
[diffusion] fix: guard sage attention sm90 bindings (#34107)
Co-authored-by: RunFMe <RunFMe@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-08 21:32:40 +08:00 |
|
|
Mick
|
db75dfe10f
|
fix: always capture default prefill CUDA graph (#33352)
|
2026-08-08 19:24:49 +08:00 |
|
|
Mick
|
cf2d4fd679
|
docs: clarify K3 VLM feature transport (#34099)
|
2026-08-08 19:23:00 +08:00 |
|
|
Leon Gao
|
cfb354bcfc
|
[Bugfix] Fix batched KV free aliasing (#34067)
|
2026-08-08 03:34:44 -07:00 |
|
|
Liangsheng Yin
|
a1ca76b24b
|
[Scheduler] Unify WAR read-done gating behind shared-read boundary declarations (#34052)
|
2026-08-08 03:26:36 -07:00 |
|
|
Liangsheng Yin
|
2c0188cc78
|
[Fix] Give the piecewise CUDA graph test stub an hf_config (#34100)
|
2026-08-08 02:04:16 -07:00 |
|
|
Liangsheng YinandBaizhou Zhang
|
f6a6f5bf1e
|
[CI] Trim redundant nightly test registrations (#34070)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-08-08 01:42:46 -07:00 |
|
|
|
dd5d82bead
|
[NPU] Improve the execution efficiency and maintainability of pr‑test‑npu (#33724)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-08-08 16:42:44 +08:00 |
|
|
xdtbynd
|
e732c0a9dc
|
[UT][NPU] add unit tests for ascend_torch_native_backend and mla_preprocess (#32505)
|
2026-08-08 16:15:12 +08:00 |
|
|
DarkSharpnessandClaude Fable 5
|
4ad5bb5d9a
|
[jit_kernel] Move JIT kernels into namespace sglang (#33400)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 16:10:15 +08:00 |
|
|
Yuan Luo
|
5fdf6cd18f
|
[MoE] Single-launch moe_align for tiny batches with many experts (#32395)
|
2026-08-08 16:08:25 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
891445676c
|
[diffusion] Sana: bit-exact fused aten LayerNorm+modulate under BCG (H200 denoise -4.8%) (#34015)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 16:05:25 +08:00 |
|
|
Mick
|
d747bd052e
|
feat(vlm): auto-select cuda vmm on multi-node mnnvl (#33936)
|
2026-08-08 16:00:58 +08:00 |
|
|
Mick
|
db3898fec1
|
fix: avoid piecewise prefill graph for trtllm_mla (#32785)
|
2026-08-08 16:00:10 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
afb4f37ca5
|
[Inkling] silu_and_mul: replace helion kernels with plain Triton (#33903)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 15:00:23 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
d238e36b24
|
[Fix] Restore data_parallel_rank alias on native /generate (dp-aware gateway routing is silently dropped) (#33565)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 14:59:16 +08:00 |
|
|
Baizhou Zhang
|
c9444deef4
|
Docker: install DeepEP from release wheels (#34041)
|
2026-08-07 23:51:09 -07:00 |
|
|
Eric ZhangandClaude Opus 5
|
c69d59395b
|
[inkling] Render tool-result media instead of coercing content to str (#33898)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 14:39:19 +08:00 |
|
|
Aurick Qiao
|
6185ed8011
|
Add registered short-conv tests and backend extensions (#34045)
|
2026-08-08 14:38:03 +08:00 |
|
|
Thomas Wang
|
6679d9b60c
|
[AMD] Add K3 verified mla kernel for DSpark on triton backend (#33981)
|
2026-08-07 22:59:26 -07:00 |
|
|
Cheng Wan
|
b61a06921e
|
moe: the shared-experts-fusion decision is a per-runner value the loader installs (#33889)
|
2026-08-07 22:42:58 -07:00 |
|
|
Cheng Wan
|
eda0ddc260
|
config: delete the dead get_server_args() bindings across the repo (#33888)
|
2026-08-07 22:41:53 -07:00 |
|
|
Cheng Wan
|
a5af27f49e
|
config: retire ServerArgs.derive; per-runner values are constructor arguments (#33887)
|
2026-08-07 22:41:09 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
5dffa06fe1
|
[diffusion] GLM-Image bit-exact fused aten LayerNorm+modulate / qk-LN (H200 30-step denoise -8.1%) (#34008)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 13:26:11 +08:00 |
|
|
Xiaoyu Zhang
|
148f15b0af
|
[diffusion] FLUX.1 fused adaLN modulate (bit-exact) + RoPE cache hoist, LN-affine folding behind quality=high (H200 e2e -3.5% lossless / -6.9% high) (#34004)
|
2026-08-08 13:07:42 +08:00 |
|
|
|
f64328c7f6
|
[diffusion] feat: support quant-videogen prq kv-cache quantization (memory-saving) for causal-dit (#32581)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-08 12:56:54 +08:00 |
|
|
MickandClaude Fable 5
|
24c84dfa68
|
[diffusion] doc: add parallelism overview (#33704)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 11:36:06 +08:00 |
|
|
RunningLeonandXinyuan Tong
|
55f02e6887
|
Support Intern-S2-Mobius (#33691)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-08-08 11:06:57 +08:00 |
|
|
MickandClaude Fable 5
|
a25c330eb1
|
[diffusion] feat: cross-node sequence parallelism (Ulysses x Ring) (#33327)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 10:56:28 +08:00 |
|
|
MickandClaude Fable 5
|
52afe87a08
|
[diffusion] fix: stop runai-model-streamer's rank-discovery collective from firing on independent per-rank loads (#33969)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 08:54:08 +08:00 |
|
|
paulzhang-tm
|
209857334e
|
[Scheduler] Gate SWA eviction on accumulated tokens (#33404)
|
2026-08-08 08:28:26 +08:00 |
|
|
Ke Bao
|
633838b0ec
|
Add the 8-gpu Inkling consistency test (#34009)
|
2026-08-08 08:24:08 +08:00 |
|
|
Ke Bao
|
ce84df0fa1
|
Fix deterministic inference for Inkling (#33417)
|
2026-08-08 07:48:15 +08:00 |
|
|
Joe RowellandJimmy Shong
|
1d812865dc
|
[Laguna] fix YaRN mscale double-application in rope config (#33558)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-08-07 16:46:08 -07:00 |
|
|
Liangsheng Yin
|
c59d2b4329
|
[Fix] Judge the phase-checker device-assert test by its FAIL line, not the exit code (#34017)
|
2026-08-07 16:19:05 -07:00 |
|
|
Douglas YangandClaude Opus 5
|
86f373daff
|
docs(cookbook): DeepSeek-V4-Flash-0731 — drop chunked-prefill/autotune flags on B300 low-latency (#34044)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-07 23:12:56 +00:00 |
|
|
Zhiqiang Xie
|
3dc91366ac
|
[HiCache] write_back: reclaim duplicated host copy first under host pressure (#33777)
|
2026-08-07 15:59:59 -07:00 |
|
|
Baizhou Zhang
|
eb3cc879e0
|
Install DeepEP from release wheels (#33932)
|
2026-08-07 15:38:44 -07:00 |
|
|
Faradawn Yang
|
115cd7bde1
|
docs: update checkpoint to Qwen3.5 NVFP4 V2 for InfX (#32945)
|
2026-08-07 15:26:07 -07:00 |
|
|
|
b2f9603f93
|
[bugfix] Stop/EOS inside a spec accept run beats the max_new_tokens finish (#33758)
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
|
2026-08-07 15:18:14 -07:00 |
|
|
Khoa PhamandClaude Opus 5
|
07297049e9
|
config: route DCP topology reads through get_parallel() (#33925)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-07 14:53:54 -07:00 |
|
|
cctryandkangwangamd
|
df3aa20d89
|
Reland serving-time Triton load diagnostics (#33908)
Co-authored-by: kangwangamd <100359556+kangwangamd@users.noreply.github.com>
|
2026-08-07 14:51:43 -07:00 |
|
|
Baizhou Zhang
|
8fc66d1a62
|
docker: pin Kimi images to SGLang commit (#34030)
|
2026-08-07 14:49:26 -07:00 |
|