 MickandMick Qian
|
2ee82fe158
|
[diffusion] model: support Anima Base v1.0 (#41011)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-26 09:53:51 +08:00 |
|
 Liangsheng YinandDarkSharpness
|
0967a013c2
|
[DSv4.1] Move the ratio-1/2 index top-k ops into kernels/ops/attention/dsv4 (#41291)
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-09-25 18:28:04 -07:00 |
|
Xiaoyu Zhang
|
85374532f2
|
[diffusion] Fuse lossless Klein packed QK RMSNorm and RoPE on Hopper (#40490)
|
2026-09-26 09:24:21 +08:00 |
|
 
|
50e50e13ab
|
[DCP] Use logical token capacity for PD admission and load reporting (#39731)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
|
2026-09-25 17:39:47 -07:00 |
|
Liangsheng Yin
|
2afd343934
|
[misc] Call all_gather_single / reduce_scatter_single to drop torch deprecation warnings (#41284)
|
2026-09-25 16:14:13 -07:00 |
|
 Liangsheng YinandBBuf
|
efd9a40bb8
|
[PD] Share one head-slice helper across mooncake, mori, and nixl (#39660)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-25 16:13:18 -07:00 |
|
Liangsheng Yin
|
516ab77619
|
[Test] Route all sgl-eval benchmarks through run_sgl_eval and deprecate run_eval (#41280)
|
2026-09-25 15:48:38 -07:00 |
|
 Kevin MiandClaude Opus 5.5
|
27e883a20d
|
dsv4.1-amd: gfx950 MXFP8 matmul kernels and fp8-grid producers (#41018)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-25 15:45:40 -07:00 |
|
 Erik WijmansandEthan Su
|
c421d16563
|
[sglang][lora] Support DP attention in LoRA backends (#36389)
Co-authored-by: Ethan (Yusheng) Su <yushengsu@radixark.ai>
|
2026-09-25 12:03:47 -10:00 |
|
 
|
cf5df82680
|
[KVCache] Support lmcache unified radix cache (#38652)
Signed-off-by: chunxiaozheng <1179548172@qq.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-25 14:08:45 -07:00 |
|
Ethan (Yusheng) Su
|
d3e3945e41
|
[LoRA] Size dense row/column-parallel LoRA buffers from the base linear's real shard (#39379)
|
2026-09-25 14:01:08 -07:00 |
|
Liangsheng Yin
|
f88572a57c
|
[Test] Add in-process sgl-eval adapter and move validated GSM8K tests to it (#41216)
|
2026-09-25 13:59:17 -07:00 |
|
Liangsheng Yin
|
f337f01b80
|
[Test] Remove dead eval modules and point GSM8K/MMLU docs to sgl-eval (#41215)
|
2026-09-25 12:50:31 -07:00 |
|
Nan Jiang
|
24b6930076
|
[Sampling] Stream sampling masks as per-request arrays (#40986)
|
2026-09-25 12:20:25 -07:00 |
|
  
|
6d35cee7fc
|
Fix multimodal feature offload races (#40621)
Co-authored-by: cctry <cctry@fb.com>
Co-authored-by: Yongji Wu <yongji@meta.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-09-25 12:18:08 -07:00 |
|
 metamergebotandYonghao Zhuang
|
671000aee6
|
[unified-memory] Honor move gates in float relocation and size auto HiCache from host capacity (#41248)
Co-authored-by: Yonghao Zhuang <yhzhuang@meta.com>
|
2026-09-25 12:17:28 -07:00 |
|
 
|
31b931edc3
|
fix(multimodal): return 400 for corrupt image inputs (#28131)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: Justin Tong <justintong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-09-25 19:51:33 +02:00 |
|
 
|
0154f72b48
|
[ROCm][Bugfix] Keep quantization for mixed Quark Qwen3.5 MTP checkpoints (#39064)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-25 10:31:29 -07:00 |
|
Even Zhou
|
67bb6a58d0
|
Revert "[NPU] Fuse FIA KV-cache K/V writes into one npu_scatter_pa_kv_cache call" (#41132)
|
2026-09-25 23:56:22 +08:00 |
|
Xiaoyu Zhang
|
2f5c9ac43d
|
[diffusion] Enable lossless Cosmos3 Super T2I QK fusion on Hopper TP2 (#40486)
|
2026-09-25 18:01:06 +08:00 |
|
 Jianghaiandmickqian
|
a749d84303
|
[Diffusion] Fix AttributeError in grouped forward_batch by installing the residency manager (#34417)
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
|
2026-09-25 17:27:38 +08:00 |
|
Cheng Wan
|
3450d68d4e
|
[Refactor] Decide an FFN exit's completion once and declare the group it owes (#41200)
|
2026-09-25 01:50:35 -07:00 |
|
Cheng Wan
|
26a3214cda
|
[Refactor] Take a layer's last-layer fact from its scatter-mode plan (#41199)
|
2026-09-25 01:49:33 -07:00 |
|
Cheng Wan
|
8f5a636f8d
|
[Refactor] Build prepare_mlp and the layout moves from named steps (#41191)
|
2026-09-25 01:48:30 -07:00 |
|
Cheng Wan
|
b7f6d04a9a
|
[Refactor] Move Step-3.5, GLM5-Next, Dots3, MiniMax-M3 and Qwen3.5 onto ffn_exit (#41198)
|
2026-09-25 01:47:43 -07:00 |
|
Cheng Wan
|
963e9fb42d
|
[Refactor] Leave the FFN reduction to the next layer under attention DP (#41197)
|
2026-09-25 01:47:03 -07:00 |
|
Cheng Wan
|
9d7f44bdbb
|
[Refactor] Carry a deferred FFN all-reduce as UnreducedOutput and complete it in the next layer without the fused kernel (#41196)
|
2026-09-25 01:46:03 -07:00 |
|
Cheng Wan
|
402df23188
|
[Fix] Stop counting a deferred FFN sum more than once: replicated TP1 shared expert, dense reduce_scatterv (#41195)
|
2026-09-25 01:45:00 -07:00 |
|
Cheng Wan
|
1409f469be
|
[Fix] Plan NextN / MTP draft layers as one-layer models and fix the Bailing V2 NextN draft (#41194)
|
2026-09-25 01:43:55 -07:00 |
|
Cheng Wan
|
51c92e8df1
|
[Fix] Complete the all-reduce when the flashinfer fused norm declines a batch (#41193)
|
2026-09-25 01:42:16 -07:00 |
|
kk
|
515f5be77e
|
[AMD] Integrate Aiter MegaMoEv2 for DeepSeek-V4 (#35619)
|
2026-09-25 00:47:08 -07:00 |
|
Shuwen Wang
|
434c2e3adc
|
[HiCache] fix: Drain pending backups before internal Mamba write-back (#41092)
|
2026-09-25 15:06:24 +08:00 |
|
Shuwen Wang
|
cbe137727e
|
[HiCache] Give trailing sidecar storage transfers a contiguous prefix_keys chain (#40456)
|
2026-09-25 15:06:05 +08:00 |
|
 MickandMick Qian
|
0fb699ac03
|
[diffusion] model: support Ming-Image Design and Design-Layer (#41067)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-25 14:44:37 +08:00 |
|
 metamergebotandXingyu Liu
|
9c8340a2e5
|
[DeepEP v2] Let a model package supply its per-rank prefill dispatch bound (#41201)
Co-authored-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
|
2026-09-24 23:39:03 -07:00 |
|
Xinyi Song
|
ec070ec8c8
|
[AMD] Fix int32 offset overflow in Triton DSv4 KV store kernels (#41159)
|
2026-09-24 23:11:59 -07:00 |
|
 Ting SUNandXinyuan Tong
|
3e7e652900
|
fix(openai): reject request-supplied chat_template by default (#28135)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-09-25 07:48:34 +02:00 |
|
Richard Wang
|
16d1c93b3d
|
[feat] add a system one compatible /v1/systemone route (#41208)
|
2026-09-25 12:59:11 +08:00 |
|
 
|
cec70a4708
|
[Fix] Keep the target's DP sync slot in draft scopes (#41062)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-09-24 21:48:39 -07:00 |
|
 
|
e0b4d66733
|
[Perf] Lazy-load built-in model definitions and nixl_ep at startup (#41061)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-09-24 20:29:33 -07:00 |
|
 
|
7325b38412
|
[PD] Honor gracefully_exit in disaggregation event loops and keep non-zero-rank launchers alive on SIGTERM (#40793)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Shiyan Deng <dsy842974287@meta.com>
|
2026-09-24 20:29:07 -07:00 |
|
akhilg-nv
|
37ebcac3c4
|
Support XQA backend for SpecDec verify (#32269)
|
2026-09-24 20:14:46 -07:00 |
|
 MickandMick Qian
|
6103a8c743
|
[diffusion] feat: add opt-in SRT prompt enhancement to image and video APIs (#41095)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-25 10:00:04 +08:00 |
|
jacky.cheng
|
9dc4c5d891
|
[AMD] Restore non-DCP Mamba checkpoint donation to fix agent-mode cache hit at high conc with HiCache (#40907)
|
2026-09-24 18:08:10 -07:00 |
|
Liangsheng Yin
|
8ca82118e0
|
[mem_cache] Drop is_insert from cache_finished_req; release rows from release_kv_cache (#40988)
|
2026-09-24 17:23:26 -07:00 |
|
 Shuwen Wangandhnyls2002
|
a2025b8c4d
|
[DSV4] Account for FlashMLA physical KV page padding in memory budgets (#41091)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-24 17:14:08 -07:00 |
|
Sundara Raman Ramachandran
|
2f2f9d12f8
|
[Score API] Setwise Scoring Support (#38965)
|
2026-09-24 16:50:58 -07:00 |
|
 
|
7c5bdb940c
|
[PD] Add a none decode retraction backup and subclass seams in the PD queues (#41103)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <zqx@meta.com>
|
2026-09-24 16:13:54 -07:00 |
|
 
|
466e985f4b
|
[HiCache] Batch buffer-only KV backups within each flush (#40960)
Co-authored-by: oss-sync bot (pranjalssh) <pranjalssh@users.noreply.github.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
|
2026-09-24 16:13:02 -07:00 |
|
 Caio RochaandCaio Rocha
|
e047e50d4e
|
Add 8-node AllReduce/AllGather and MNVLS algorithm support to MSCCL++ (#37442)
Co-authored-by: Caio Rocha <caiorocha@microsft.com>
|
2026-09-24 15:51:29 -07:00 |
|