 Mick
|
db75dfe10f
|
fix: always capture default prefill CUDA graph (#33352)
|
2026-08-08 19:24:49 +08:00 |
|
|
Leon Gao
|
cfb354bcfc
|
[Bugfix] Fix batched KV free aliasing (#34067)
|
2026-08-08 03:34:44 -07:00 |
|
|
Liangsheng Yin
|
a1ca76b24b
|
[Scheduler] Unify WAR read-done gating behind shared-read boundary declarations (#34052)
|
2026-08-08 03:26:36 -07:00 |
|
|
|
dd5d82bead
|
[NPU] Improve the execution efficiency and maintainability of pr‑test‑npu (#33724)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-08-08 16:42:44 +08:00 |
|
|
DarkSharpnessandClaude Fable 5
|
4ad5bb5d9a
|
[jit_kernel] Move JIT kernels into namespace sglang (#33400)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 16:10:15 +08:00 |
|
|
Yuan Luo
|
5fdf6cd18f
|
[MoE] Single-launch moe_align for tiny batches with many experts (#32395)
|
2026-08-08 16:08:25 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
891445676c
|
[diffusion] Sana: bit-exact fused aten LayerNorm+modulate under BCG (H200 denoise -4.8%) (#34015)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 16:05:25 +08:00 |
|
|
Mick
|
d747bd052e
|
feat(vlm): auto-select cuda vmm on multi-node mnnvl (#33936)
|
2026-08-08 16:00:58 +08:00 |
|
|
Mick
|
db3898fec1
|
fix: avoid piecewise prefill graph for trtllm_mla (#32785)
|
2026-08-08 16:00:10 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
afb4f37ca5
|
[Inkling] silu_and_mul: replace helion kernels with plain Triton (#33903)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 15:00:23 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
d238e36b24
|
[Fix] Restore data_parallel_rank alias on native /generate (dp-aware gateway routing is silently dropped) (#33565)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 14:59:16 +08:00 |
|
|
Eric ZhangandClaude Opus 5
|
c69d59395b
|
[inkling] Render tool-result media instead of coercing content to str (#33898)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-08 14:39:19 +08:00 |
|
|
Aurick Qiao
|
6185ed8011
|
Add registered short-conv tests and backend extensions (#34045)
|
2026-08-08 14:38:03 +08:00 |
|
|
Thomas Wang
|
6679d9b60c
|
[AMD] Add K3 verified mla kernel for DSpark on triton backend (#33981)
|
2026-08-07 22:59:26 -07:00 |
|
|
Cheng Wan
|
b61a06921e
|
moe: the shared-experts-fusion decision is a per-runner value the loader installs (#33889)
|
2026-08-07 22:42:58 -07:00 |
|
|
Cheng Wan
|
eda0ddc260
|
config: delete the dead get_server_args() bindings across the repo (#33888)
|
2026-08-07 22:41:53 -07:00 |
|
|
Cheng Wan
|
a5af27f49e
|
config: retire ServerArgs.derive; per-runner values are constructor arguments (#33887)
|
2026-08-07 22:41:09 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
5dffa06fe1
|
[diffusion] GLM-Image bit-exact fused aten LayerNorm+modulate / qk-LN (H200 30-step denoise -8.1%) (#34008)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 13:26:11 +08:00 |
|
|
Xiaoyu Zhang
|
148f15b0af
|
[diffusion] FLUX.1 fused adaLN modulate (bit-exact) + RoPE cache hoist, LN-affine folding behind quality=high (H200 e2e -3.5% lossless / -6.9% high) (#34004)
|
2026-08-08 13:07:42 +08:00 |
|
|
|
f64328c7f6
|
[diffusion] feat: support quant-videogen prq kv-cache quantization (memory-saving) for causal-dit (#32581)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-08 12:56:54 +08:00 |
|
|
RunningLeonandXinyuan Tong
|
55f02e6887
|
Support Intern-S2-Mobius (#33691)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-08-08 11:06:57 +08:00 |
|
|
MickandClaude Fable 5
|
a25c330eb1
|
[diffusion] feat: cross-node sequence parallelism (Ulysses x Ring) (#33327)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 10:56:28 +08:00 |
|
|
MickandClaude Fable 5
|
52afe87a08
|
[diffusion] fix: stop runai-model-streamer's rank-discovery collective from firing on independent per-rank loads (#33969)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 08:54:08 +08:00 |
|
|
paulzhang-tm
|
209857334e
|
[Scheduler] Gate SWA eviction on accumulated tokens (#33404)
|
2026-08-08 08:28:26 +08:00 |
|
|
Ke Bao
|
ce84df0fa1
|
Fix deterministic inference for Inkling (#33417)
|
2026-08-08 07:48:15 +08:00 |
|
|
Joe RowellandJimmy Shong
|
1d812865dc
|
[Laguna] fix YaRN mscale double-application in rope config (#33558)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-08-07 16:46:08 -07:00 |
|
|
Zhiqiang Xie
|
3dc91366ac
|
[HiCache] write_back: reclaim duplicated host copy first under host pressure (#33777)
|
2026-08-07 15:59:59 -07:00 |
|
|
Baizhou Zhang
|
eb3cc879e0
|
Install DeepEP from release wheels (#33932)
|
2026-08-07 15:38:44 -07:00 |
|
|
|
b2f9603f93
|
[bugfix] Stop/EOS inside a spec accept run beats the max_new_tokens finish (#33758)
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
|
2026-08-07 15:18:14 -07:00 |
|
|
Khoa PhamandClaude Opus 5
|
07297049e9
|
config: route DCP topology reads through get_parallel() (#33925)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-07 14:53:54 -07:00 |
|
|
cctryandkangwangamd
|
df3aa20d89
|
Reland serving-time Triton load diagnostics (#33908)
Co-authored-by: kangwangamd <100359556+kangwangamd@users.noreply.github.com>
|
2026-08-07 14:51:43 -07:00 |
|
|
Nan Jiang
|
8600457731
|
[Spec] Propagate state capture outputs in DFlash (#34026)
|
2026-08-07 14:42:30 -07:00 |
|
|
YAMY
|
9e3f6b746b
|
fix(mamba): widen causal_conv1d token offsets to int64 (#33665)
|
2026-08-07 14:31:48 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
b3ee679467
|
[MXFP8] Use FlashInfer CUTLASS for dense GEMM on SM120, delete Triton path (#33208)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-08-07 14:30:43 -07:00 |
|
|
Dmitrii Sergeev
|
699fcdc936
|
Fix _pa_swa_prefill_lens off-by-one in FlashAttentionBackend (#33379)
|
2026-08-07 14:06:48 -07:00 |
|
|
Sam ShleiferandClaude Fable 5
|
62a28197c0
|
Autotune flashinfer extend buckets at warmup (#32556)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-07 14:06:05 -07:00 |
|
|
Zhangheng
|
1480687cff
|
[CP]: Support CP V2 Strategy for dsv4 (#33532)
|
2026-08-07 14:03:27 -07:00 |
|
|
Sam Shleifer
|
8e7d361def
|
[perf] Compute input logprobs without materializing the full-vocab log-softmax (#31958)
|
2026-08-07 14:01:08 -07:00 |
|
|
Hanming LuandLianmin Zheng
|
b53a39c5e4
|
Limit prefill delayer debug logs to rank zero (#34020)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-08-07 13:41:19 -07:00 |
|
|
Oguz UlgenandYinghai Lu
|
7f6b4cb94b
|
Add CUDA VMM multimodal feature transport (#33899)
Co-authored-by: Yinghai Lu <yinghai@meta.com>
|
2026-08-07 13:39:54 -07:00 |
|
|
|
3c51e29deb
|
Responses support (#32689)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Harmya Bhatt <harmyacs@gmail.com>
Co-authored-by: harmya <harmya@modal.com>
Co-authored-by: Xinyuan <xinyuan@radixark.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-08-07 13:21:46 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
6c7498113f
|
[diffusion] Enable breakable CUDA graph for SANA (H200 1024px e2e -26%, bit-exact) (#33989)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-07 23:54:39 +08:00 |
|
|
Zhangheng
|
12de7fb1f6
|
Remove the HiMambaRadixTree that is no longer in use (#33468)
|
2026-08-07 23:01:40 +08:00 |
|
|
Xiaoyu Zhang
|
d4be483efb
|
[diffusion] Enable breakable CUDA graph for LTX-2 (H200 two-stage e2e 10.75 s -> 6.90 s, 1.56x) (#33885)
|
2026-08-07 22:29:14 +08:00 |
|
|
|
bc148dfdc8
|
[diffusion] feat: make scheduler rpc deadlines explicit (#33965)
Co-authored-by: suoyf <suoyf@nscc-tj.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-07 21:33:23 +08:00 |
|
|
danielafrimi
|
4020bc95a7
|
Fix Nemotron W4A16 NVFP4 MoE backend (#33543)
Signed-off-by: dafrimi <dafrimi@nvidia.com>
|
2026-08-07 12:00:28 +00:00 |
|
|
Mick
|
5ca734fc3d
|
[diffusion] UX: speed up tp and fsdp checkpoint loading (#33960)
|
2026-08-07 19:23:30 +08:00 |
|
|
Dayananda V
|
1034977318
|
[diffusion] fix: bind each rank to accelerator before distributed init (#33054)
|
2026-08-07 19:01:58 +08:00 |
|
|
Yihao WangandClaude Opus 5
|
acb64db9e2
|
[diffusion] fix: enable bcg with tp (#33421)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-07 19:01:05 +08:00 |
|
|
|
fe52b49827
|
Fix IndexError in Triton backend with pipeline parallelism (#30340)
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-08-07 18:58:04 +08:00 |
|