Liangsheng Yin
|
95fb722dd2
|
Add registry for custom speculative algorithms (#23991)
|
2026-05-07 16:11:45 -07:00 |
|
Revanth Reddy Airre
|
c2c57068da
|
fix(http): apply SGLANG_TIMEOUT_KEEP_ALIVE in common.py (#24323)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
|
2026-05-07 16:01:41 -07:00 |
|
Xinyuan Tong
|
5b589ed2e7
|
feat(constrained): two-phase reasoning grammar + --enable-strict-thinking (#23953)
|
2026-05-07 14:21:51 -07:00 |
|
Xinyuan Tong
|
af2a2ac618
|
fix(function_call): handle Kimi-K2.5 bare numeric tool call IDs (#23950)
|
2026-05-07 14:20:02 -07:00 |
|
Xinyuan Tong
|
d8f9d32a05
|
feat(reasoning): auto-detect reasoning/tool-call parser from chat template (#23952)
|
2026-05-07 14:19:16 -07:00 |
|
 Khoa PhamandPengyu Chen
|
d2c1034163
|
[Gemma 4] Adding MTP support (#24436)
Co-authored-by: Pengyu Chen <pychen96@gmail.com>
|
2026-05-07 14:08:41 -07:00 |
|
Xinyuan Tong
|
f1395af543
|
fix(openai): map reasoning.enabled to thinking AND enable_thinking (#23951)
|
2026-05-07 14:01:35 -07:00 |
|
R0CKSTAR
|
9cffa5ed6f
|
[MUSA] Bump torchada to 0.1.54 (#24592)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-05-07 11:45:49 -07:00 |
|
Revanth Reddy Airre
|
be088f8076
|
fix(router): configure HTTP client connection settings (#24330)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
|
2026-05-07 11:42:45 -07:00 |
|
  
|
90a618e37b
|
[NPU][diffusion] add selectable parallel VAE decode strategies (#23248)
Co-authored-by: 高鑫 <gaoxin@gaoxindeMacBook-Pro.local>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-07 21:37:03 +03:00 |
|
![github-actions[bot]](/assets/img/avatar_default.png) 
|
80a6014243
|
✨ [diffusion][npu][quant] Add MXFP8 quantization support for Wan2.2 Diffusion on Ascend NPU (#20922)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2026-05-07 21:30:56 +03:00 |
|
 McZyWuandsglang-npu-bot
|
7d397ad23d
|
[NPU]Support model Trinity-mini for Npu, accuracy 90% (#18172)
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-05-07 20:58:18 +03:00 |
|
Mick
|
b0225a69dc
|
[diffusion] optimize: precompute LTX2 guidance perturbation states (#24494)
|
2026-05-08 01:18:42 +08:00 |
|
 YC Yen-Ching Tsengandbingxche
|
c18879054f
|
[AMD] Route PR multimodal tests to MI325 (#24614)
Co-authored-by: bingxche <bingxche@amd.com>
|
2026-05-07 23:26:05 +08:00 |
|
 ykcai-danielandMick
|
9c41b1058f
|
[diffusion] refactor: refactor cfg parallelism framework to support multi-branch CFG for LTX2 (#23736)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-05-07 22:56:55 +08:00 |
|
 Vladimir Serovandronnie_zheng
|
263cb3b222
|
[LoRA] Torch Native enhancement: embedding and graph optimization (#21885)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-07 17:28:38 +03:00 |
|
ovidiusm
|
811d138c8a
|
Nixl async transfer (#23967)
Signed-off-by: Ovidiu Mara <ovidium@nvidia.com>
|
2026-05-07 22:05:43 +08:00 |
|
 Yuxuan ZhangandShangming Cai
|
ec4560304b
|
[Bug Fix] Preserve decode state across retract-resume of GLM-5.1 (#23346)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-07 21:37:53 +08:00 |
|
Shangming Cai
|
e264b5785d
|
[PD] Centralize per-room cleanup in common backend (#24601)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-07 18:47:55 +08:00 |
|
inkcherry
|
3b2c730320
|
[AMD] Enable dual-stream MoE on ROCm (#24005)
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
|
2026-05-07 02:27:24 -07:00 |
|
Hanming Lu
|
92f281f856
|
[Spec][trtllm] use decode kernel for draft extend (#24566)
|
2026-05-07 02:25:26 -07:00 |
|
Liangsheng Yin
|
a6dc49545e
|
Let bypass-fastfail label skip stage-to-stage wait (#24598)
|
2026-05-07 02:20:27 -07:00 |
|
weireweire
|
684638e053
|
Fix prefill batch iter logging under overlap (#20845)
|
2026-05-07 02:10:42 -07:00 |
|
Polisetty V R K Jyothendra Varma
|
9dfb1d2ebe
|
[Intel GPU] Fix flash_mla_get_workspace_size call in intel_xpu (#24372)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
|
2026-05-07 13:45:32 +08:00 |
|
 Kangyan-ZhouandClaude Opus 4.7
|
a2586f1c53
|
[CI] pin NeMo-Skills install to known-good SHA in accuracy_test_runner (#24581)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-06 22:24:48 -07:00 |
|
 Yanbin Jiangandgh1595
|
f0368a6666
|
[LoRA] Use deterministic lora_id for --lora-paths so multi-node ranks agree (#24555)
Co-authored-by: gh1595 <278903827+gh1595@users.noreply.github.com>
|
2026-05-06 22:20:15 -07:00 |
|
Revanth Reddy Airre
|
d363315de9
|
fix(router): make HTTP pool idle timeout configurable (#24329)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
|
2026-05-06 22:11:11 -07:00 |
|
Liangsheng Yin
|
8bb0ce192b
|
Add bypass-fastfail label for check-stage-health (#24577)
|
2026-05-06 21:34:06 -07:00 |
|
fzyzcjy
|
9ba4aac47b
|
Fix weight_checker e2e OOM on 32GB GPU + move to nightly (#24559)
|
2026-05-06 21:06:04 -07:00 |
|
 Jun LiuandAlex Nails
|
65ce9965ce
|
[Bug Fix] Fix RunAI streamer: corrupted weights, missing quant init, and broken URIs for multimodal models (#22715)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-05-06 19:20:04 -07:00 |
|
Baizhou Zhang
|
ecb786c8d7
|
[Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268)
|
2026-05-06 18:59:01 -07:00 |
|
Liangsheng Yin
|
eaf074d50e
|
propagate pytest exit code from test __main__ entries (#24487)
|
2026-05-06 18:46:52 -07:00 |
|
 Yuzhen ZhouandByron Hsu
|
4a279d9c36
|
[R3] Avoid implicit CUDA sync in routed experts DP slicing (#24550)
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
|
2026-05-06 18:37:36 -07:00 |
|
huangtingwei
|
27445f9836
|
Add ChatCompletionRequest-style support to /v1/tokenize (#23981)
|
2026-05-06 18:35:20 -07:00 |
|
 Brayden Zhongandb8zhong
|
3fe8bc987e
|
Support Triton MLA FP8 KV cache (#20479)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-06 18:32:39 -07:00 |
|
Mick
|
2e642ea187
|
[diffusion] chore: align LTX-2 with official (#24313)
|
2026-05-07 08:46:28 +08:00 |
|
Baizhou Zhang
|
7fa48916f5
|
Expand support matrix for pypi wheel release (#24565)
|
2026-05-06 17:39:02 -07:00 |
|
Xiaoyu Zhang
|
a9a8b20a90
|
[codex] Optimize Z-Image packed QKV (#24117)
|
2026-05-07 07:51:22 +08:00 |
|
Baizhou Zhang
|
9e1336d406
|
[Misc] Fix breaking weight checker test (#24553)
|
2026-05-06 15:42:54 -07:00 |
|
 gh1595andYanbin Jiang
|
ece7e95b65
|
[LoRA] Fix qkv_proj LoRA buffer sizing when tp_size > num_key_value_heads (#24420)
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
|
2026-05-06 14:51:30 -07:00 |
|
Alison Shao
|
e72246c6e6
|
ci: bump test_mimo_models.py est_time 330 → 610 (#24551)
|
2026-05-06 14:35:43 -07:00 |
|
 jsheng_LinkedinandClaude Opus 4.7
|
bc70488695
|
[CI] Temporarily disable marco/mcdse-2b-v1 in test_embedding_models (#24279)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-06 14:28:39 -07:00 |
|
Lianmin Zheng
|
b859f7ffba
|
Improve metrics, observability, and PD deploy tooling (#24521)
|
2026-05-06 11:27:35 -07:00 |
|
Xiaoyu Zhang
|
d86f2916cc
|
Fix diffusion fallback guards and validation (#23335)
|
2026-05-07 00:05:43 +08:00 |
|
Shangming Cai
|
32d9998b9d
|
[PD] Prevent update_status to Failed from cleared entries (#24539)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-06 23:32:04 +08:00 |
|
sky
|
bfc1aeae13
|
[CP] Register KV cache allgather buffer with symmetric memory (#24040)
Signed-off-by: wangfakang <fakangwang@gmail.com>
|
2026-05-06 23:24:36 +08:00 |
|
fzyzcjy
|
c4c5541618
|
Support getting checksums in weight checker (#24537)
|
2026-05-06 22:59:28 +08:00 |
|
fzyzcjy
|
ae5ae840f6
|
Refactor buffer patterns in weight checker (#24538)
|
2026-05-06 22:52:07 +08:00 |
|
fzyzcjy
|
800deaaefa
|
Add unit and end-to-end tests for weight checker (#24536)
|
2026-05-06 22:48:48 +08:00 |
|
 Ke Baoandhzh0425
|
eb5f0fbeef
|
Support swa HiCache for unified radix cache (#23391)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-05-06 22:19:25 +08:00 |
|