Commit Graph
16803 Commits
Author SHA1 Message Date
Yuwei AnandClaude Opus 5 955704544c [Fix] Skip padded state slots in the chunked GDN kernel (#33431)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-18 13:07:19 -07:00
307a90f6d3 Stop losing Kimi-K3 tool calls to reasoning, constraint conflicts, and truncation (#34881)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-08-18 12:42:56 -07:00
Wei YangandWei Yang 8bb106cee9 Fix NIXL cleaner grouping for hybrid cache keys (#35130)
Co-authored-by: Wei Yang <yawei@microsoft.com>
2026-08-18 13:55:51 -05:00
Hanming Lu 526af15845 [Metrics] Discount queued prefill load by recent cache hits when waiting-queue matching is off (#35248) 2026-08-18 11:27:21 -07:00
Xingyu Liuandxingyuliu 7dcaf11987 [Fix] Select custom all-reduce v2 by topology capability (#35061)
Co-authored-by: xingyuliu <xingyuliu@fb.com>
2026-08-18 10:30:10 -07:00
Ke Bao 480033def0 Refactor kv cache event mixin into a recorder (#35164) 2026-08-19 01:20:17 +08:00
jain-ria 83d7d45330 fix: preserve output logprobs without input logprobs (#34627)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
2026-08-18 12:07:13 -05:00
MickandClaude Opus 5 3f26febaff [diffusion] fix: decouple encoder parallelism from the dit parallel layout (#34713)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-19 00:16:09 +08:00
LinyuanLi 9485c083bb [NPU] Add mxfp4-w4a4 MOE Quantization Support for NPU (#30319) 2026-08-18 19:06:05 +03:00
Shangming CaiandClaude Opus 4.8 97dedd1ce9 [PD] Deferred decode-side KV release for aborts mid-transfer (#35049)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-08-18 23:56:33 +08:00
hhhh1252023 c60952d933 Exclude multimodal-gen NPU jobs from fast-fail cascade (#35238) 2026-08-18 23:48:48 +08:00
pllimax 499e90a125 [NPU CI] Reorganize test output/log directory structure with workflow context (#33685) 2026-08-18 23:46:00 +08:00
WenhaoZhang 63d783bbe0 [diffusion] optimization: INT8 Linear + pluggable DiT attention backends for MiniMax-H3 on consumer-level GPUs (#34581) 2026-08-18 21:44:39 +08:00
paulzhang-tm 0065fbfae1 [Scheduler] Cap prefill-delayer queue target by admission capacity (#35191) 2026-08-18 21:40:13 +08:00
Andy Ye 94eef833fe [diffusion] rl: support cosmos3 (#34197) 2026-08-18 20:42:27 +08:00
Xiaoyu ZhangandClaude Opus 5 ae6945e112 [kernels] Reorganize ops/diffusion by operator domain behind a lazy facade (#35114)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-18 20:37:43 +08:00
HeYaoandHeYao 7605529bdf Add deepseek_v4_flash_w8a8_8p_in32k_out1k_50ms (#35162)
Co-authored-by: HeYao <heyao@example.com>
2026-08-18 19:41:25 +08:00
YC Yen-Ching Tseng f7101b0ae6 [AMD] MiniMax-M3 : Fuse QKV+index proj for block-fp8 (#32099) 2026-08-18 03:01:01 -07:00
karverma-amd 24d625698d [AMD] feat(moe): fold padded-topk_ids fill into fused shared-experts append+remap (#31370) 2026-08-18 02:32:57 -07:00
Lianmin Zheng 70ee6b1714 [Rust Server] Add e2e latency metadata and fix Sarashina import (#35125) 2026-08-18 02:08:07 -07:00
vijay-kodamalla 880ab72f34 test: extend NVFP4 Marlin tests to SM120 (#34327) 2026-08-18 16:24:00 +08:00
mohbasit fc0b95e7ba Profiling Enhancements [2/3]: detailed execution step annotations (#24911) 2026-08-18 01:09:07 -07:00
Emil BogomolovandEmil Bogomolov 667389c50f [diffusion] chore: filter transformer safetensors by index.json to drop duplicate shard variants (#35107)
Co-authored-by: Emil Bogomolov <zetyquickly@googlemail.com>
2026-08-18 16:05:05 +08:00
Liangsheng Yin 0111b29031 [Perf] Hoist DSv4 draft-extend SWA write locs; unify SWA graph buffer naming (#34890) 2026-08-18 00:13:28 -07:00
Lianmin Zheng a779a2a2a5 [Chore] Move version tag helper to release scripts (#35196) 2026-08-18 00:11:12 -07:00
Baizhou Zhang 5b60b7c651 [DSV4] Turn on mhc post pre fusion by default (#35214) 2026-08-18 00:03:37 -07:00
Andy Ye 772018fe36 [diffusion] Per-section LoRA adapters on fused linear layers (#34933) 2026-08-17 23:40:45 -07:00
ashwini rathi 5eb117f6ca [XPU] Fix decode graph runner is_current_stream_capturing on non-CUDA devices (#35050) 2026-08-18 14:28:13 +08:00
Thomas Wang 27596abdc0 [AMD] Update amd k3 cookbook for PR#34580 (#35263) 2026-08-17 23:19:36 -07:00
Alexandrandronnie_zheng 61600c9f39 [Diffusion][Refactor] Refactor and extract complex RoPE implementation to layers/rotary_embedding for MOVA DiT (#31453)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-08-18 09:14:35 +03:00
Jiajun Li e6df23f3c2 refactor: rename chat response token IDs (#35225) 2026-08-17 23:07:43 -07:00
Shuwen Wang 0077f84d37 [mem_cache][8/N] refactor: move MambaPoolHost to pool_host.mamba (#31180) 2026-08-18 05:22:45 +00:00
Colin Z ea27e3ddab [AMD] Fix Quark Shared Experts Fusion Gate after load-time-override Removal (#35200) 2026-08-17 22:10:01 -07:00
Zhiyao Jiang 9401db3f29 [AMD] Scope the EAGLE greedy-verify TP broadcast to ROCm only (#35195) 2026-08-17 21:38:24 -07:00
8ea5229d42 [AMD] Add the Kimi-K3 MI35x perf benchmarks in nightly (#34985)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
2026-08-17 21:23:51 -07:00
Ke Bao d528192bf9 Skip inkling sheared bias under batch invariance (#35161) 2026-08-18 12:22:58 +08:00
amd-danli103andThomas Wang d01812d89e [AMD] Optimize KIMI-K3 with Triton MLA decode kernel by tuning the stage-1 geometry for gfx950 (#34580)
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-08-17 21:16:14 -07:00
Baizhou Zhang 53621818e4 [Docs] Enable PD disaggregation for DSV4 low-latency recipes (#35224) 2026-08-17 20:07:27 -07:00
Khoa PhamandClaude Opus 5 f44a130c5e [DCP] Drop the prefill index-selection syncs by taking each rank's rows by stride (#35084)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-17 19:55:51 -07:00
Siyuan Chen fcdaaf8a5d [Feature] Optimize TP LMHead with All-to-All (#32313) 2026-08-17 19:55:27 -07:00
jiayisunxandMa Mingfei d6c837489a [XPU] Enable fused GDN QKV split Triton kernel on XPU (#30144)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-18 10:42:58 +08:00
Ma Mingfei 7f51e6bba0 [CPU] Explicitly import sgl_kernel in CPU kernel tests (#35119) 2026-08-18 10:20:28 +08:00
MickandYiqi Yang d55f1c28e2 [diffusion] feat: load quantized H3 text encoder checkpoints (#34986)
Co-authored-by: Yiqi Yang <yangyiqi8787@gmail.com>
2026-08-18 09:10:54 +08:00
Zaili Wang 0ea262e6e5 [XPU] xpu kernel release workflow (#33679) 2026-08-17 18:07:48 -07:00
Baizhou Zhang c2c1c4d3eb [CI] Move DSA PD+MTP+CP Layersplit test to basic B300 test suite (#35220) 2026-08-17 17:44:31 -07:00
sglang-botandsglang-bot 9ffc2856fb docs: sync LMSYS SGLang blog cards (#35218)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-08-17 17:30:28 -07:00
Faradawn Yang 91144797c5 Update Qwen3.5 H200 FP8 for AgentX HiCache MTP (#35194) 2026-08-17 17:12:07 -07:00
Liangsheng Yin c0b6474b43 [Spec] Reduce host-side overhead in ngram draft prep (#35207) 2026-08-17 16:40:06 -07:00
Cheng Wan b3c8f0d923 config: one control-plane log for the process (#35028) 2026-08-17 16:19:00 -07:00
Cheng Wan c70c7d72a8 config: the readback and the resolving view say what they are (#35027) 2026-08-17 16:18:19 -07:00