 Qiaolin Yu
|
f293ddf3ce
|
[perf] reduce overhead of fill_ids list reconstruction and decref (#27965)
|
2026-06-14 00:41:11 -07:00 |
|
|
Yongji Wu
|
f2d7d67603
|
numa: bind within allowed CPUs when affinity is already constrained (#26983)
|
2026-06-14 00:38:40 -07:00 |
|
|
|
b796338271
|
Fix prefill delayer wait histograms always observing 0 (#25975)
Co-authored-by: kingjameschan <170807154+kingjameschan@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Humphrey <181440142+humphreysun98@users.noreply.github.com>
|
2026-06-14 00:35:29 -07:00 |
|
|
David Wang
|
8c5320b37e
|
dflash add sliding window attention draft layer support (#27469)
|
2026-06-14 00:32:02 -07:00 |
|
|
Liangsheng Yin
|
bb48405c31
|
Unify NVTX annotation helpers and split the enable gate per subsystem (#28165)
|
2026-06-14 00:04:59 -07:00 |
|
|
ybyang
|
50993554d8
|
fix(health): make health-check rid unique across tokenizer workers (#28143)
|
2026-06-14 00:01:52 -07:00 |
|
|
|
f79a6b5c33
|
Support GLM-4.7 function calling via structural tags (#28149)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-06-14 14:57:07 +08:00 |
|
|
Mick
|
37ed10bd24
|
[diffusion] UX: reduce attention backend log noise (#28169)
|
2026-06-14 14:55:13 +08:00 |
|
|
DarkSharpnessandClaude
|
cc72e2bd8c
|
[Docs] Fix outdated benchmark marker API in add-jit-kernel skill (#27773)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-13 23:47:30 -07:00 |
|
|
Ting SUN
|
b250bea994
|
fix(sampling): reject non-finite temperature in SamplingParams.verify (#28153)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-13 23:41:36 -07:00 |
|
|
Yuzhen Zhou
|
171037c3e7
|
Fix Qwen3.5 deterministic batch-invariant logprobs (#27869)
|
2026-06-13 23:23:06 -07:00 |
|
|
Yanbin Jiang
|
1747b88c5e
|
[LoRA] Support DSA indexer LoRA targets for GLM-5.1 / DeepSeek-V3.2-family models (#28110)
|
2026-06-13 23:02:33 -07:00 |
|
|
Mick
|
31ac743484
|
[diffusion] chore: improve server warmup coverage (#28127)
|
2026-06-14 13:35:42 +08:00 |
|
|
Chao Shi
|
5fb4e2d02e
|
[UnifiedTree] Use Qwen3-32B in unified radix pp kl tests and set KL threshold to 0.005 (#27931)
|
2026-06-14 13:15:35 +08:00 |
|
|
Mohammad Miadh Angkad
|
91c63aeb4d
|
Fix stale CUDA graph benchmark and docs refs (#28041)
|
2026-06-13 21:51:42 -07:00 |
|
|
Jared Wen
|
5da3b37a9d
|
[CI] add Precision Regression Test on Nightly Run CI (#26902)
|
2026-06-14 12:43:57 +08:00 |
|
|
JoyFuture
|
a3fd5c24be
|
feat: add NVTX markers for the scheduler main loop (#27901)
|
2026-06-13 17:16:53 -07:00 |
|
|
Chang Min Bark
|
93b402580c
|
feat: add decode clear steps env var (#28160)
|
2026-06-13 17:15:42 -07:00 |
|
|
|
3f4a338212
|
[AMD][Quantization] Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs (#18182)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-06-13 16:08:19 -07:00 |
|
|
billishyahao
|
10d3337048
|
[AMD] Support unified_kv_triton for disaggregation (#27935)
|
2026-06-13 14:08:27 -07:00 |
|
|
Oleg ZhelezniakandYorkSu
|
8a9f2aa116
|
fix: prevent stale bitmask leakage in LLGuidance grammar backend (#23653)
Signed-off-by: jellysnack <oleg.jellysnack@gmail.com>
Co-authored-by: YorkSu <45256779+YorkSu@users.noreply.github.com>
Co-authored-by: jellysnack <oleg.jellysnack@gmail.com>
|
2026-06-13 13:27:08 -07:00 |
|
|
Xinyuan Tong
|
47fabb52ed
|
docs(minimax-m3): add high-concurrency throughput tip for H200 bf16 (#28150)
|
2026-06-13 13:09:59 -07:00 |
|
|
Cheng Wan
|
27ba13358e
|
[Spec] Clear dead DRAFT_EXTEND objects left after EAGLE v1 removal (#28133)
|
2026-06-13 13:04:51 -07:00 |
|
|
Cheng Wan
|
bde6bccf39
|
[Spec] Remove deprecated EAGLE v1 DRAFT_EXTEND forward mode (#28129)
|
2026-06-13 13:00:21 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
d988d5d681
|
feat(cookbook): generic config-declared flagSelects playground axis (#28128)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-13 11:46:34 -07:00 |
|
|
jianzhao-xu
|
29128f31fd
|
[NPU] Best Practice Docs Splitting (#27663)
|
2026-06-13 22:16:20 +08:00 |
|
|
|
0e592395c7
|
[Apple Silicon] [MLX] Fuse SwiGLU activation into gate gather_qmv for SwitchGLU MoE blocks (#26188)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-06-13 21:57:57 +08:00 |
|
|
Yuhao Yang
|
aea0e30853
|
[4/N] Qwen3.5Opt: Overlap mamba verify update with draft extend (#26924)
|
2026-06-13 20:29:20 +08:00 |
|
|
McZyWu
|
f7041c9dee
|
step3.5 flash revise for graph mode and use triton activation (#27739)
|
2026-06-13 16:34:20 +08:00 |
|
|
|
806365e778
|
feat: Support HiCache for MiMo-V2 models (1/N) (#27378)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-06-13 15:40:27 +08:00 |
|
|
billishyahao
|
60d4bd4c70
|
[AMD] fix moriep quant kernel not implemented issue (#27855)
|
2026-06-13 00:35:41 -07:00 |
|
|
Yongji Wu
|
568aa5fcdb
|
Fix missing draft KV pool transfers in HybridCacheController (#27953)
|
2026-06-13 15:17:31 +08:00 |
|
|
Zhangheng
|
8ce05e8a20
|
[UnifiedTree]: Pin host buffers across async H→D in UnifiedRadixCache.load_back (#27444)
|
2026-06-13 15:16:56 +08:00 |
|
|
inkcherryandDuyi-Wang
|
eb9483b5c2
|
[PD][AMD]: incremental KV transfer with decode radix cache (#26288)
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-06-13 00:06:44 -07:00 |
|
|
shuwenn
|
f4029d0fc0
|
[HiCache] fix: clear storage reset state (#26009)
|
2026-06-12 23:51:26 -07:00 |
|
|
Mick
|
cb4933b22e
|
[diffusion] optimize: enable vae parallel decode with cfg-parallel (#27875)
|
2026-06-13 13:52:27 +08:00 |
|
|
Jonah Bernardandjonahbernard
|
bcd45d3ac7
|
[AMD][DFlash] Add DFlash test to AMD CI (#28112)
Co-authored-by: jonahbernard <Jonah.Bernard@amd.com>
|
2026-06-12 22:06:41 -07:00 |
|
|
Mick
|
8becb37519
|
[diffusion] warmup: improve diffusion server warmup (#28119)
|
2026-06-13 13:04:10 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
eb18416f9f
|
[jit-kernel] Support per token group quant 8bit v2 jit kernel (#27449)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-13 12:15:09 +08:00 |
|
|
Michael
|
053e153183
|
[AMD] ci: register 8 attention-backend unit tests to run on AMD CI (#27817)
|
2026-06-12 20:52:45 -07:00 |
|
|
Xinyu Zhang
|
1800d7caa6
|
Bump ray minimum version to 2.55.1 (#27724)
|
2026-06-12 20:49:11 -07:00 |
|
|
mqhc2020
|
f288283c07
|
[AMD] move shared expert check function to quark (#27057)
|
2026-06-12 20:45:59 -07:00 |
|
|
EvanderFBoopandgemini-code-assist[bot]
|
d8f8e89ffb
|
[Test] Add unit tests for srt/mem_cache/utils.py (#27913)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-06-12 20:38:57 -07:00 |
|
|
Liangsheng Yin
|
32ef040618
|
[Spec] Move eagle verify prepare_for_verify/sample to eagle_utils free helpers (#28117)
|
2026-06-12 20:37:33 -07:00 |
|
|
Qiaolin Yu
|
e02f7ca482
|
[perf] remove several h2d sync (#28076)
|
2026-06-12 20:30:17 -07:00 |
|
|
Lianmin Zheng
|
b001d3e815
|
Add prajjwal1 to CI_PERMISSIONS.json (#28120)
|
2026-06-12 20:26:38 -07:00 |
|
|
Khoa Pham
|
a0c6e0b3a4
|
chore: bump tokenspeed_mla 0.1.1 -> 0.1.6 (#28116)
|
2026-06-12 19:57:36 -07:00 |
|
|
Ting SUN
|
ade30fd494
|
fix(server): serialize nested dict config values as JSON (#28094)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-12 19:27:31 -07:00 |
|
|
Ting SUN
|
e9c3b262e4
|
[Bugfix][Spec] Fix multi-layer EAGLE DRAFT_EXTEND_V2 attn-TP logprob metadata capture (#28026)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-12 19:26:35 -07:00 |
|
|
Khoa PhamandQiaolin Yu
|
d1a39b0c74
|
[DeepSeek V3] Defer moe finalize and fused it with main stream add (#27720)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-06-12 19:00:51 -07:00 |
|