Commit Graph
14036 Commits
Author SHA1 Message Date
Bingxu ChenandCursor 19c78552dc [AMD] Restrict CI image fallback to versioned tags (#28263)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-15 16:08:48 +08:00
Xinyuan Tongandzijiexia 33f99831f8 docs(minimax-m3): refresh B200 benchmarks (tp8, piecewise) + add GPQA (#28207)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-06-15 00:15:38 -07:00
Jia-Wei Jiang a88ba6cc0b [Fix] Reduce power of two to constant time (#28228)
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
2026-06-14 23:25:22 -07:00
Duyi-Wang 63df86f5e7 [AMD] Skip eplb bookkeeping and topk remap when EPLB is not in use on mori-ep / HIP (#22985) (#28188) 2026-06-14 23:00:23 -07:00
Mick 578e936d8d [diffusion] feat: persist torch.compile inductor/triton cache across restarts (#28205) 2026-06-15 13:34:19 +08:00
07b9108348 [Diffusion] FLUX: fuse FeedForward GELU into up-proj GEMM (cublasLt epilogue) (#28166)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-15 13:00:26 +08:00
Prajjandprajjwal1 441b75ee69 [quantization] NVFP4 MoE: split fused w13 gate/up global scales (#27588)
Co-authored-by: prajjwal1 <prajjwal1@protonmail.com>
2026-06-14 21:18:36 -07:00
Ryan Zzzandzhujunyu ce9fad7196 [Bugfix][DeepSeek-V4] Fix Spec V2 Draft Input ID Dtype for DP Collectives (#28043)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
2026-06-14 21:11:53 -07:00
weireweire bf38a0b03d Fix disaggregated decode load token accounting (#25736) 2026-06-15 11:37:41 +08:00
0417951a86 [Bug Fix] Validate tokenizer-dependent features with skip_tokenizer_init (#27882)
Co-authored-by: Randall <randall@iterationlab.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-14 20:07:52 -07:00
Zyann 37505eca27 feat: report multimodal (image/audio/video) token counts in usage.prompt_tokens_details (#27122) 2026-06-15 11:04:10 +08:00
Kangyan-ZhouandClaude Opus 4.8 c0dfe4c8ec [router] Reconcile workers that registered without resolving model_ids (#27980)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-14 18:47:50 -07:00
Mohammad Miadh Angkad 69b02ea68a [Distributed] Guard torch symm mem all-reduce sizes (#24548) 2026-06-14 18:28:57 -07:00
Xinyuan Tong 1a66059c4e [Spec] Restore index_share_for_mtp_iteration in EAGLE V2 draft worker (#28192) 2026-06-14 18:01:11 -07:00
Michael c127ba6483 [AMD] ci: fix scheduled AMD runs startup failure when calling extra-a suite (#28214) 2026-06-14 17:43:47 -07:00
Xinyuan Tong 000fc975c7 ci(docker): support layered overlay images in release-docker-dev (#28206) 2026-06-14 16:34:02 -07:00
Lianmin Zheng f18d38d040 Revert "[AMD][Quantization] Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs" (#28213) 2026-06-14 13:34:06 -07:00
Mick 3cb29f6747 [diffusion] feat: use regional torch.compile (compile_repeated_blocks) for DiT of diffusers backend (#28193) 2026-06-15 00:34:10 +08:00
Mick ec36dde580 [diffusion] feat: add --warmup-mode enum server arg (#28184) 2026-06-14 23:09:04 +08:00
Mick 582bd23f71 [diffusion] feat: enable spatial-shard vae decode across GPUs (#28071) 2026-06-14 20:19:44 +08:00
d72314808f [JIT Kernel] Multi-GPU test/bench framework for custom all-reduce + TP QKNorm (#26706)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: ziyi.xu <ziyi.xu@radixark.ai>
2026-06-14 17:20:36 +08:00
Mick 5331de0f8c [diffusion] chore: resolve model_index.json Hub-first with local-cache fallback (#28177) 2026-06-14 16:48:38 +08:00
Humphrey 8c334e2224 fix(io_struct): index extra_key per sub-request in batched GenerateReqInput (#26971) 2026-06-14 00:50:38 -07:00
Mick 1456eb612d [diffusion] CI: tighten perf baselines (#28123) 2026-06-14 15:50:21 +08:00
Jimmy Shongandgithub-actions[bot] 54acffc864 Eval accuracy gpqa aime25 mixins (#27102)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-06-14 00:49:12 -07:00
Qiaolin Yu f293ddf3ce [perf] reduce overhead of fill_ids list reconstruction and decref (#27965) 2026-06-14 00:41:11 -07:00
Yongji Wu f2d7d67603 numa: bind within allowed CPUs when affinity is already constrained (#26983) 2026-06-14 00:38:40 -07:00
b796338271 Fix prefill delayer wait histograms always observing 0 (#25975)
Co-authored-by: kingjameschan <170807154+kingjameschan@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Humphrey <181440142+humphreysun98@users.noreply.github.com>
2026-06-14 00:35:29 -07:00
David Wang 8c5320b37e dflash add sliding window attention draft layer support (#27469) 2026-06-14 00:32:02 -07:00
Liangsheng Yin bb48405c31 Unify NVTX annotation helpers and split the enable gate per subsystem (#28165) 2026-06-14 00:04:59 -07:00
ybyang 50993554d8 fix(health): make health-check rid unique across tokenizer workers (#28143) 2026-06-14 00:01:52 -07:00
f79a6b5c33 Support GLM-4.7 function calling via structural tags (#28149)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-06-14 14:57:07 +08:00
Mick 37ed10bd24 [diffusion] UX: reduce attention backend log noise (#28169) 2026-06-14 14:55:13 +08:00
DarkSharpnessandClaude cc72e2bd8c [Docs] Fix outdated benchmark marker API in add-jit-kernel skill (#27773)
Co-authored-by: Claude <noreply@anthropic.com>
2026-06-13 23:47:30 -07:00
Ting SUN b250bea994 fix(sampling): reject non-finite temperature in SamplingParams.verify (#28153)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
2026-06-13 23:41:36 -07:00
Yuzhen Zhou 171037c3e7 Fix Qwen3.5 deterministic batch-invariant logprobs (#27869) 2026-06-13 23:23:06 -07:00
Yanbin Jiang 1747b88c5e [LoRA] Support DSA indexer LoRA targets for GLM-5.1 / DeepSeek-V3.2-family models (#28110) 2026-06-13 23:02:33 -07:00
Mick 31ac743484 [diffusion] chore: improve server warmup coverage (#28127) 2026-06-14 13:35:42 +08:00
Chao Shi 5fb4e2d02e [UnifiedTree] Use Qwen3-32B in unified radix pp kl tests and set KL threshold to 0.005 (#27931) 2026-06-14 13:15:35 +08:00
Mohammad Miadh Angkad 91c63aeb4d Fix stale CUDA graph benchmark and docs refs (#28041) 2026-06-13 21:51:42 -07:00
Jared Wen 5da3b37a9d [CI] add Precision Regression Test on Nightly Run CI (#26902) 2026-06-14 12:43:57 +08:00
JoyFuture a3fd5c24be feat: add NVTX markers for the scheduler main loop (#27901) 2026-06-13 17:16:53 -07:00
Chang Min Bark 93b402580c feat: add decode clear steps env var (#28160) 2026-06-13 17:15:42 -07:00
3f4a338212 [AMD][Quantization] Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs (#18182)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-06-13 16:08:19 -07:00
billishyahao 10d3337048 [AMD] Support unified_kv_triton for disaggregation (#27935) 2026-06-13 14:08:27 -07:00
Oleg ZhelezniakandYorkSu 8a9f2aa116 fix: prevent stale bitmask leakage in LLGuidance grammar backend (#23653)
Signed-off-by: jellysnack <oleg.jellysnack@gmail.com>
Co-authored-by: YorkSu <45256779+YorkSu@users.noreply.github.com>
Co-authored-by: jellysnack <oleg.jellysnack@gmail.com>
2026-06-13 13:27:08 -07:00
Xinyuan Tong 47fabb52ed docs(minimax-m3): add high-concurrency throughput tip for H200 bf16 (#28150) 2026-06-13 13:09:59 -07:00
Cheng Wan 27ba13358e [Spec] Clear dead DRAFT_EXTEND objects left after EAGLE v1 removal (#28133) 2026-06-13 13:04:51 -07:00
Cheng Wan bde6bccf39 [Spec] Remove deprecated EAGLE v1 DRAFT_EXTEND forward mode (#28129) 2026-06-13 13:00:21 -07:00
zijiexiaandClaude Opus 4.8 d988d5d681 feat(cookbook): generic config-declared flagSelects playground axis (#28128)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 11:46:34 -07:00