 Mick
|
22faf9fef8
|
embedding: centralize capabilities and complete OpenAI compatibility (#32481)
|
2026-07-30 10:28:52 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
62dfaaa0e0
|
[Nemotron] Fix decode track-save reading the stale tail of the CUDA-graph track buffer (#32555)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-29 19:03:44 -07:00 |
|
|
Xuanyi LiandR0CKSTAR
|
8fbf960980
|
[MLX] Size request capacity by attention DP (#32115)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-07-29 18:18:22 -07:00 |
|
|
Xiaoyu Zhang
|
1d9c292547
|
[Kernel] Add inventory guards and clean benchmark layout (#32788)
|
2026-07-30 09:03:24 +08:00 |
|
|
Mohammad Miadh Angkad
|
a55e1764a2
|
Enable GPT-OSS FlashInfer MXFP4 on SM120 (#32668)
|
2026-07-30 00:04:23 +00:00 |
|
|
Liangsheng Yin
|
e5c46ff07d
|
[Fix] Route asymmetric-KV models to fa4 on SM100 and pin MiMoV2 FP8 MoE to flashinfer_trtllm (#32818)
|
2026-07-29 16:37:43 -07:00 |
|
|
Sam (Kesen Li)
|
8fc54d46ef
|
Fix MoE reduce-scatterv eligibility check (#32663)
|
2026-07-29 14:58:55 -07:00 |
|
|
Willow LopezandJiminator
|
ffd4705baa
|
fix(reasoning): honor Poolside template thinking defaults (#32540)
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com>
|
2026-07-29 21:02:19 +00:00 |
|
|
Sam Shleifer
|
d0e69d3881
|
[feat] Optional base64 encoding for the flat prompt top logprob arrays (#31960)
|
2026-07-29 12:15:56 -07:00 |
|
|
ziang663andChao Shi
|
eefb434d17
|
[PD+PP] Honor PP consensus for bootstrap and prealloc (#31869)
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
|
2026-07-30 01:19:17 +08:00 |
|
|
Yoray Zack
|
62d0f81f16
|
[2/N] elastic-ep: Enable EPLB after scale-up (#30553)
|
2026-07-30 01:06:56 +08:00 |
|
|
Hert4andMohammad Miadh Angkad
|
f69af7b7ad
|
[Bugfix] compressed-tensors: mixed-precision checkpoints silently load unquantized (#32736)
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-07-29 09:55:33 -07:00 |
|
|
YAMY
|
fddfc1fb5e
|
[GDN] Support FlashInfer GDN prefill with extra-buffer radix cache (#29735)
|
2026-07-30 00:47:35 +08:00 |
|
|
huangtingweiandalphabetc1
|
50029f05a3
|
[HiCache] Merge HiCache event checks to reduce decode overhead (#30511)
Co-authored-by: alphabetc1 <47200617+alphabetc1@users.noreply.github.com>
|
2026-07-29 23:48:48 +08:00 |
|
|
Bingxu Chen
|
bfc450248e
|
[AMD] Replace MI325 with MI300 CI Runners (#31409)
|
2026-07-29 08:18:07 -07:00 |
|
|
Ke Bao
|
50b029257f
|
Skip mamba lock during decoding (#32228)
|
2026-07-29 21:53:28 +08:00 |
|
|
pllimax
|
d004a15a3e
|
Fix GLM4-7B-Flash accuracy test configuration, tune Qwen3.6-27B/35B performance test parameters, and harden Ascend NPU multi-node E2E test utilities against pod name format errors. (#32371)
|
2026-07-29 21:44:17 +08:00 |
|
|
LZW
|
4c82bb3252
|
Add Mooncake tenant id support (#30256)
|
2026-07-29 18:17:41 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
8742a1a0f8
|
Add a benchmark script for the HPC-Ops bf16xfp32 router GEMM (#32642)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-29 18:17:08 +08:00 |
|
|
Xiaoyu Zhang
|
c32c4ef79c
|
[Kernel] Move sgl-kernel under sglang.kernels.aot (#32648)
|
2026-07-29 17:25:00 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
7dcebca255
|
Fix nightly CI: NVFP4 cuda-graph crash, NVILA batching, CuTe paged-KV zero-size, Kimi-VL OOM (#32118)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-29 01:39:55 -07:00 |
|
|
Liangsheng Yin
|
cce5873513
|
[CI] Fail lint when a registered file's TestCase classes never run (#32735)
|
2026-07-29 00:45:01 -07:00 |
|
|
Mick
|
da5528db30
|
fix(vlm): materialize Qwen3-VL features on the vision device (#31596)
|
2026-07-29 15:25:04 +08:00 |
|
|
siweil
|
9bdbb180b1
|
[Disagg][NIXL] Fix heterogeneous attn-TP KV transfer for replicated GQA heads (NIXL_ERR_NOT_FOUND) (#31968)
|
2026-07-29 14:13:23 +08:00 |
|
|
|
ef6c07008b
|
Support DCP for Kimi Linear model (#32612)
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
|
2026-07-28 22:59:58 -07:00 |
|
|
Liangsheng Yin
|
c4fc241fd3
|
[Perf] Free KV pages by segment in the paged allocator without a device sync (#32701)
|
2026-07-28 22:24:16 -07:00 |
|
|
Xun Sun
|
bf6e80718a
|
[Elastic EP] fix previously flaky test of test_mooncake_ep_small.py (#31706)
|
2026-07-29 13:14:12 +08:00 |
|
|
Xiaojun(Robin) Zhang
|
1af0167493
|
[EPD][VLM] Fix Kimi-VL 2D encoder grids (#32104)
Signed-off-by: Xiaojun Zhang <zhangxiaojunhust@gmail.com>
|
2026-07-29 11:46:17 +08:00 |
|
|
|
339bef7fad
|
[MLX] Fix overlap-loop request bookkeeping and graceful shutdown (#32447)
Co-authored-by: xiaolin2004 <uwowmhdjwpwpwdhwkw@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-07-28 19:04:53 -07:00 |
|
|
|
580b1acbe6
|
[MLX] Move fused swiglu tests to test/registered so CI collects them (#32448)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-07-28 19:04:24 -07:00 |
|
|
Leon GaoandAndrew Gu
|
ee678910f7
|
[Kernel] Skip KV writes to reserved padding slots (#32477)
Co-authored-by: Andrew Gu <andrew@thinkingmachines.ai>
|
2026-07-29 09:58:18 +08:00 |
|
|
Lianmin Zheng
|
9ca4023b13
|
[Core] Clean up array-like msgspec structs (#32688)
|
2026-07-28 16:25:22 -07:00 |
|
|
Mick
|
70ea37e7e0
|
vlm: reject moss vision metadata mismatches (#31957)
|
2026-07-29 07:09:54 +08:00 |
|
|
Xiaoyu Zhang
|
c9947b087b
|
Enable multimodal prefill BCG for VL and audio models (#30872)
|
2026-07-29 06:47:40 +08:00 |
|
|
Xiaoyu Zhang
|
7778dd23ea
|
[diffusion] refactor: remove stale kernels and dead code (#32651)
|
2026-07-29 06:23:23 +08:00 |
|
|
Void
|
7f438a6031
|
feat: SM120 (Blackwell Desktop) support for GLM-5.1 inference (#26928)
|
2026-07-28 14:52:34 -07:00 |
|
|
Ethan (Yusheng) Su
|
0a49226d19
|
[LoRA] 1/n Per-rank tensor serialization for load_lora_adapter_from_tensors under dp_size > 1 (#32580)
|
2026-07-28 14:28:56 -07:00 |
|
|
YAMY
|
dd67452b4f
|
[Cleanup] Move mamba-max-states-per-path validation into _handle_mamba_backend (#32502)
|
2026-07-28 14:21:21 -07:00 |
|
|
paulzhang-tmandClaude Fable 5
|
4e5a05148a
|
[FullCG] Support chunked cached-prefix prefill (#30825)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-28 11:20:25 -07:00 |
|
|
IvanShan177andClaude Opus 4.8
|
1eee8fbdcc
|
[PD] Drain NIXL completion notifications before enforcing the WaitingForInput timeout (#32267)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-29 00:20:03 +08:00 |
|
|
Xinyuan TongandFAN YUCHEN
|
ee236086db
|
Fix invalid escape warnings in tool parsers (#28370)
Co-authored-by: FAN YUCHEN <2994114386@qq.com>
|
2026-07-28 23:31:47 +08:00 |
|
|
|
32c30c0f96
|
Return 400 instead of 500 for unfetchable or unparseable multimodal inputs (#31417)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-07-28 05:23:42 -07:00 |
|
|
Xiaoyu Zhang
|
9cffc2ba52
|
[Kernel] Remove unused implementations and stale registry entries (#32636)
|
2026-07-28 18:12:10 +08:00 |
|
|
Zhangheng
|
60d6914f17
|
[UnifiedTree]: move /mem_cache/unifed_cache_component dir to /mem_cache/unified_cache (#32484)
|
2026-07-28 16:28:21 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
d9cf7b0a8b
|
[MTP] Cut spec-v2 host-seam overhead in hybrid-linear MTP decode (#32219)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-07-28 11:38:33 +08:00 |
|
|
longxin9715
|
356c11d5d9
|
[Fix] --mm-process-config crash when video config contains (#30260)
|
2026-07-28 09:24:40 +08:00 |
|
|
|
8d6549bc40
|
[Attention Backend] Extend hpc_ops dynamic-scheduled decode to bf16 (#32304)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
|
2026-07-27 21:31:04 +08:00 |
|
|
|
1d350aaad3
|
fix(reasoning): let --enable-strict-thinking works for DeepSeek-V4 (#32400)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-07-27 18:15:47 +08:00 |
|
|
Jackey HuaandClaude Opus 5
|
9a0bd24bed
|
model: serve bare Qwen3Model backbone natively as an embedding model (#32457)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-07-27 15:49:58 +08:00 |
|
|
Sam Shleifer
|
5cc273a780
|
[feat] Opt-in flat response format for prompt top logprobs (#32078)
|
2026-07-26 23:44:34 -07:00 |
|