 Mick
|
ed67b73081
|
[diffusion] UX: reduce hot-path server log noise (#37804)
|
2026-09-04 13:31:00 +08:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
ca7b8efd87
|
[CI] Fix handle_platform_cp_compatibility reading legacy CP flags off the record (#37930)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-03 22:07:04 -07:00 |
|
|
|
f478b2bb2d
|
Fix: abort handling for dispatched requests after client disconnect (#35255)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: cctry <cctry@fb.com>
|
2026-09-03 21:51:57 -07:00 |
|
|
ashwini rathi
|
e787de5478
|
[XPU][CI] Move XPU tests to nightly and add per-subclass server launch timeout (#37532)
|
2026-09-04 12:51:26 +08:00 |
|
|
Mohammad Miadh Angkad
|
3ad3f23ed5
|
[Comm] Drop the in-tree MNNVL CuTe DSL port in favor of FlashInfer 0.6.18 (#37206)
|
2026-09-03 21:49:48 -07:00 |
|
|
Mick
|
97d081ac76
|
[diffusion] chore: remove unreachable cosmos3 transfer encoding (#37805)
|
2026-09-04 12:14:03 +08:00 |
|
|
Baizhou Zhang
|
ff1285cc28
|
[CP V1 Deprecation 2/5] Make strategy prefill CP canonical (#36223)
|
2026-09-03 20:24:19 -07:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
c1b4d535d7
|
[CI] Fix lint (#37895)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-03 18:37:50 -07:00 |
|
|
Aleksi Vesanto
|
5e81d462c3
|
[diffusion] fix: only use fused qk_norm on nvidia gpu (#33994)
|
2026-09-04 09:25:08 +08:00 |
|
|
Li Jinliang
|
6c63d678d5
|
[diffusion] webui: fix minimax h3 webui inference settings (#36320)
|
2026-09-04 09:24:14 +08:00 |
|
|
Kedi WuandKedi Wu
|
94eb15eb6c
|
[diffusion] quant: support fp8 mixed precision for cosmos3 (#36380)
Co-authored-by: Kedi Wu <kediw@nvidia.com>
|
2026-09-04 09:23:38 +08:00 |
|
|
Mick
|
2a0602c7ac
|
[diffusion] optimization: unfused w2 bias on SM12.x (cuBLAS 16x16 kernel mis-dispatch) for minimax-h3 vae decoder: (#37835)
|
2026-09-04 09:17:23 +08:00 |
|
|
Mick
|
795dd7abce
|
[diffusion] feat: compose third-party component bundles safely (#37816)
|
2026-09-04 09:15:05 +08:00 |
|
|
heziiop
|
9ed2721c6d
|
[NPU] fix extend_seq_lens_cpu shape in eager mode (#36843)
|
2026-09-04 09:03:30 +08:00 |
|
|
Liangsheng Yin
|
6147a54ddf
|
[PD] Bound transfer engine init with SGLANG_DISAGGREGATION_ENGINE_INIT_TIMEOUT (#37874)
|
2026-09-03 17:16:55 -07:00 |
|
|
Yueming Yuan
|
66d60433c1
|
state_capturer: pin the exact host-cache size via mmap + cudaHostRegister (#37285)
|
2026-09-03 16:20:59 -07:00 |
|
|
Zhiqiang Xie
|
b44496389c
|
[HiCache] Count hit allocations and in-flight backups in the buffer pipeline idle check (#37883)
|
2026-09-03 16:08:50 -07:00 |
|
|
Zhiqiang Xie
|
a480f388b2
|
[HiCache] L3 storage prefetch lifecycle metrics and cross-tier attribution fixes (#37503)
|
2026-09-03 16:00:04 -07:00 |
|
|
Yonghao Zhuangandyhzhuang
|
4dc9cda5f9
|
[PD] Gate deferred decode KV release on backend capability (#37454)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
|
2026-09-03 15:42:21 -07:00 |
|
|
Mohammad Miadh Angkad
|
4372b8efa7
|
[1/N] Quantization Refactor: remove dead code and dedup the FP4 marlin helpers (#37552)
|
2026-09-03 14:22:31 -07:00 |
|
|
Lianmin Zheng
|
05dbe64dff
|
Fix buffer-mode idle tracking and VLM memory sizing (#37567)
|
2026-09-03 13:56:12 -07:00 |
|
|
Liangsheng Yin
|
2a980cbf10
|
[mem_cache] Require page-aligned starts in free_segment and drop the boundary trim (#37729)
|
2026-09-03 13:28:33 -07:00 |
|
|
Zhiqiang Xie
|
d0c95f6c91
|
[HiCache] buffer mode: anchor-lock staged prefetches by default (#37464)
|
2026-09-03 12:08:22 -07:00 |
|
|
Zhiqiang Xie
|
68978f8d52
|
[Scheduler] Count the parked chunked-prefill request in the busy mem check (#37502)
|
2026-09-03 12:08:17 -07:00 |
|
|
Zhanghengand晟海
|
abed680320
|
[Unified Cache][5/N]: Integrate external linker mode end to end (#37381)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-09-04 02:02:58 +08:00 |
|
|
Lianmin Zheng
|
619ab2bcce
|
Fix block-scale swizzling device placement (#37849)
|
2026-09-03 10:47:04 -07:00 |
|
|
|
23ab10a63e
|
Support speculative decoding with unified SWA memory (#36403)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-09-03 10:44:57 -07:00 |
|
|
cctry
|
33a22b1b08
|
[Cache] Forward fast prefix matching capability (#37844)
|
2026-09-03 10:33:30 -07:00 |
|
|
Yash AkhauriandBBuf
|
392841f47c
|
[Bugfix] Support K2 Horizon MoE without MoVA (#37825)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-03 23:53:16 +08:00 |
|
|
triple-muandmickqian
|
bf71035d39
|
[diffusion] MiniMax-H3: tiered AdaLN plan cache (pinned-host tier + per-plan LRU) (#37266)
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
|
2026-09-03 22:09:21 +08:00 |
|
|
Quanli Liand全力
|
4e37882a93
|
[Diffusion][minimax-h3] Add SM120 support for SubBlock sparse attention (#37332)
Co-authored-by: 全力 <liquanli.lql@antgroup.com>
|
2026-09-03 22:05:22 +08:00 |
|
|
pllimax
|
3239baef25
|
[CI][NPU] Fix kimi_k2_6 16p in64k perf test and dsv4-flash testcases (#37760)
|
2026-09-03 21:57:14 +08:00 |
|
|
dujifengandmickqian
|
9cb38a3d57
|
[diffusion] feat: filter duplicate precision variants across custom loaders (#37616)
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
|
2026-09-03 21:54:11 +08:00 |
|
|
Yihao WangandClaude Fable 5
|
f5bed255c0
|
[diffusion] feat: support key masks on USPAttention's replicated-prefix path (#36735)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-03 20:13:33 +08:00 |
|
|
Yihao WangandClaude Fable 5
|
14444c6a04
|
[diffusion] feat: add maybe_record_function profiler spans for request phases (#35922)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-03 20:12:54 +08:00 |
|
|
|
2bb25dc18b
|
[Speculative Decoding] Add native UNO serving support (#37667)
Co-authored-by: drproduck <drproduck@MacBook-Air-2.local>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-03 20:08:41 +08:00 |
|
|
Cheng Wan
|
a11dba1a01
|
[Feature] Unified memory: support decode context parallelism for the trtllm_mla family (#37693)
|
2026-09-03 03:37:12 -07:00 |
|
|
Duyi-Wang
|
429ac2d82c
|
[AMD] Fix DSv4 draft extend taking the target compression path during prefill (#37713)
|
2026-09-03 02:46:49 -07:00 |
|
|
|
27b7a2dc3b
|
[Kimi K3] Rework skipped-think fix as opt-in force_nonempty_content with streaming coverage (#34187)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-09-03 17:37:28 +08:00 |
|
|
kkandwunhuang
|
a6001478f4
|
[AMD] Perf Kimi-K3 MoE optimization (#33838)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-09-03 02:28:28 -07:00 |
|
|
Xinyi SongandThomas Wang
|
7ed29eba80
|
[AMD] Fix FP4 indexer OOR (#37660)
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
|
2026-09-03 01:49:46 -07:00 |
|
|
|
3bac084d4e
|
[Model] Add native IFM K2 Horizon serving support (#37654)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-03 16:39:43 +08:00 |
|
|
YC Yen-Ching TsengandPhil Li
|
1fb85053e7
|
[AMD][Diffusion] Migrate FlyDSL fused norm kernels to the v0.3.0 stable API (#36349)
Co-authored-by: Phil Li <haicli@amd.com>
|
2026-09-02 23:03:08 -07:00 |
|
|
xiaobochen-amdandZhang, Jiejing
|
030d7e7e9b
|
[ROCm] Define the DSA head-gate graph helpers on HIP (#37118)
Co-authored-by: Zhang, Jiejing <jiejing.zhang@amd.com>
|
2026-09-02 22:55:45 -07:00 |
|
|
Liangsheng Yin
|
54da74e83e
|
[Fix] Broadcast PP dynamic-chunk profiling failures so every rank disables together (#37675)
|
2026-09-02 21:09:04 -07:00 |
|
|
Khoa PhamandClaude Opus 5
|
cf3173aeb9
|
[Perf] Walk the radix tree by offset instead of re-slicing token storage (ported from #36507) (#37324)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-03 11:13:03 +08:00 |
|
|
James Liu
|
4229088a48
|
feat(kernels): generalize persistent CuTe JIT cache (#33911)
|
2026-09-02 19:59:04 -07:00 |
|
|
Alex NailsandAlison Shao
|
28262c20df
|
[CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
|
2026-09-02 19:46:08 -07:00 |
|
|
|
2641e427be
|
Xpu/weekly simple model enablement 2026 08 30 (#37193)
Co-authored-by: dayanandav <dayananda.vasantha.kumar@intel.com>
Co-authored-by: Girijala, Pavan Sivaram <pavan.sivaram.girijala@intel.com>
Co-authored-by: Cui, Lily <lily.cui@intel.com>
Co-authored-by: Juan Muneton <juan.muneton.gallego@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
|
2026-09-03 09:35:59 +08:00 |
|
|
Liangsheng Yin
|
a522c8a4b6
|
[misc] Extract PP dynamic chunk sizing into a DynamicChunkSizer scheduler component (#37674)
|
2026-09-02 18:35:43 -07:00 |
|