Commit Graph
16359 Commits
Author SHA1 Message Date
Joe RowellandJimmy Shong 1d812865dc [Laguna] fix YaRN mscale double-application in rope config (#33558)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
2026-08-07 16:46:08 -07:00
Liangsheng Yin c59d2b4329 [Fix] Judge the phase-checker device-assert test by its FAIL line, not the exit code (#34017) 2026-08-07 16:19:05 -07:00
Douglas YangandClaude Opus 5 86f373daff docs(cookbook): DeepSeek-V4-Flash-0731 — drop chunked-prefill/autotune flags on B300 low-latency (#34044)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-07 23:12:56 +00:00
Zhiqiang Xie 3dc91366ac [HiCache] write_back: reclaim duplicated host copy first under host pressure (#33777) 2026-08-07 15:59:59 -07:00
Baizhou Zhang eb3cc879e0 Install DeepEP from release wheels (#33932) 2026-08-07 15:38:44 -07:00
Faradawn Yang 115cd7bde1 docs: update checkpoint to Qwen3.5 NVFP4 V2 for InfX (#32945) 2026-08-07 15:26:07 -07:00
b2f9603f93 [bugfix] Stop/EOS inside a spec accept run beats the max_new_tokens finish (#33758)
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
2026-08-07 15:18:14 -07:00
Khoa PhamandClaude Opus 5 07297049e9 config: route DCP topology reads through get_parallel() (#33925)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-07 14:53:54 -07:00
cctryandkangwangamd df3aa20d89 Reland serving-time Triton load diagnostics (#33908)
Co-authored-by: kangwangamd <100359556+kangwangamd@users.noreply.github.com>
2026-08-07 14:51:43 -07:00
Baizhou Zhang 8fc66d1a62 docker: pin Kimi images to SGLang commit (#34030) 2026-08-07 14:49:26 -07:00
Xinyuan Tong 0da25ee6f7 Docs: Ling-3.0-flash cookbook — serve native 256K, drop YaRN override (#33882) 2026-08-07 21:46:51 +00:00
Nan Jiang 8600457731 [Spec] Propagate state capture outputs in DFlash (#34026) 2026-08-07 14:42:30 -07:00
YAMY 9e3f6b746b fix(mamba): widen causal_conv1d token offsets to int64 (#33665) 2026-08-07 14:31:48 -07:00
Brayden ZhongandBrayden Zhong b3ee679467 [MXFP8] Use FlashInfer CUTLASS for dense GEMM on SM120, delete Triton path (#33208)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-08-07 14:30:43 -07:00
Dmitrii Sergeev 699fcdc936 Fix _pa_swa_prefill_lens off-by-one in FlashAttentionBackend (#33379) 2026-08-07 14:06:48 -07:00
Sam ShleiferandClaude Fable 5 62a28197c0 Autotune flashinfer extend buckets at warmup (#32556)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-07 14:06:05 -07:00
Zhangheng 1480687cff [CP]: Support CP V2 Strategy for dsv4 (#33532) 2026-08-07 14:03:27 -07:00
Sam Shleifer 8e7d361def [perf] Compute input logprobs without materializing the full-vocab log-softmax (#31958) 2026-08-07 14:01:08 -07:00
Baizhou Zhang 8a22b8305d docker: add Kimi K3 artifacts and build hpc-ops with C++20 (#33956) 2026-08-07 13:50:44 -07:00
Hanming LuandLianmin Zheng b53a39c5e4 Limit prefill delayer debug logs to rank zero (#34020)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-08-07 13:41:19 -07:00
Oguz UlgenandYinghai Lu 7f6b4cb94b Add CUDA VMM multimodal feature transport (#33899)
Co-authored-by: Yinghai Lu <yinghai@meta.com>
2026-08-07 13:39:54 -07:00
3c51e29deb Responses support (#32689)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Harmya Bhatt <harmyacs@gmail.com>
Co-authored-by: harmya <harmya@modal.com>
Co-authored-by: Xinyuan <xinyuan@radixark.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-08-07 13:21:46 -07:00
Xiaoyu ZhangandClaude Fable 5 6c7498113f [diffusion] Enable breakable CUDA graph for SANA (H200 1024px e2e -26%, bit-exact) (#33989)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-07 23:54:39 +08:00
Zhangheng 12de7fb1f6 Remove the HiMambaRadixTree that is no longer in use (#33468) 2026-08-07 23:01:40 +08:00
Xiaoyu Zhang d4be483efb [diffusion] Enable breakable CUDA graph for LTX-2 (H200 two-stage e2e 10.75 s -> 6.90 s, 1.56x) (#33885) 2026-08-07 22:29:14 +08:00
bc148dfdc8 [diffusion] feat: make scheduler rpc deadlines explicit (#33965)
Co-authored-by: suoyf <suoyf@nscc-tj.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-07 21:33:23 +08:00
Ke Bao bc8c037041 Fix vae fast path test after the gate refactor (#33983) 2026-08-07 20:45:19 +08:00
danielafrimi 4020bc95a7 Fix Nemotron W4A16 NVFP4 MoE backend (#33543)
Signed-off-by: dafrimi <dafrimi@nvidia.com>
2026-08-07 12:00:28 +00:00
Mick 5ca734fc3d [diffusion] UX: speed up tp and fsdp checkpoint loading (#33960) 2026-08-07 19:23:30 +08:00
Dayananda V 1034977318 [diffusion] fix: bind each rank to accelerator before distributed init (#33054) 2026-08-07 19:01:58 +08:00
Yihao WangandClaude Opus 5 acb64db9e2 [diffusion] fix: enable bcg with tp (#33421)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-07 19:01:05 +08:00
fe52b49827 Fix IndexError in Triton backend with pipeline parallelism (#30340)
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-08-07 18:58:04 +08:00
Lennox FuandMick 7af3d000f2 [diffusion] feat: gate /health and /health_generate on warmup completion and add liveness endpoint (#33787)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-07 17:59:23 +08:00
Pan LiandMick a42683eb62 [diffusion] model: support lingbot-video moe 30b t2v (#32341)
Signed-off-by: Pan Li <pandalee@ustc.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-07 17:57:01 +08:00
MickandClaude Fable 5 13938fed3f [diffusion] feat: make ring admission a backend capability (#33928)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-07 17:55:44 +08:00
MickandClaude Fable 5 28b43bf693 [diffusion] perf: build qwen's masked varlen metadata host-side (#33954)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-07 17:55:15 +08:00
Ke Bao 0756a1d2b0 Move SWA chunk-cap hatch tests into the registered suite (#33975) 2026-08-07 17:49:07 +08:00
amote-i 470807ef74 [NPU] [DOC] Upgrade recommendeded sglang version on Ascend NPU (#33976) 2026-08-07 17:45:00 +08:00
Xiaoyu ZhangandClaude Fable 5 572434e2f6 [diffusion] Z-Image bit-exact fused qk-norm (H200 Turbo 1024px e2e -6.4%) (#33886)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-07 17:03:28 +08:00
Baizhou Zhang 5e60363960 Fix prefill CP graph overflow with larger bucket search (#33906) 2026-08-07 01:33:14 -07:00
Liangsheng Yin 7395ee833e [CI] Share VLM engines and prune launch matrices on the per-commit H100/H200 suites (#33944) 2026-08-07 01:22:22 -07:00
Trevor Morris 3ed2a0adf3 feat: Add flashinfer mHC fusion for DSV4 (#33616) 2026-08-07 08:01:33 +00:00
MickandClaude Fable 5 85d611a055 [diffusion] fix: scope the masked-path replicated guard to sp runs (#33953)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-07 15:45:50 +08:00
weireweireandweireweire 5e58af1503 Fix fractional simulated acceptance in DSpark (#33463)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-07 00:45:07 -07:00
Mick 9aadacfc53 [diffusion] CI: exercise the default sp selection in CI (#33931) 2026-08-07 14:20:19 +08:00
triple-mu a79340dedd [diffusion] fix: minimax-h3 text encoder device mismatch under --text-encoder-cpu-offload (#33864) 2026-08-07 14:04:20 +08:00
Zhaoyi Li fc9479243e [AMD][DI][CI] 8/N Add GLM-5.2 MXFP4 1P1D DI/CI recipes (base + MTP + DP8/EP8) (#32120) 2026-08-06 22:56:40 -07:00
Leon Gao 4d4f8023c4 [srt] Batch scheduler cache frees (#33475) 2026-08-06 21:49:59 -07:00
Mick c2657cc4bf [diffusion] refactor: gate fast vae paths by quality (#33849) 2026-08-07 12:39:55 +08:00
WenhaoZhang 914644e81c [diffusion] fix: fix 4/8-step distilled minimax-h3 turbo lora merge (#33875) 2026-08-07 12:38:37 +08:00