 Vladimir Serovandronnie_zheng
|
263cb3b222
|
[LoRA] Torch Native enhancement: embedding and graph optimization (#21885)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-07 17:28:38 +03:00 |
|
|
fzyzcjy
|
9ba4aac47b
|
Fix weight_checker e2e OOM on 32GB GPU + move to nightly (#24559)
|
2026-05-06 21:06:04 -07:00 |
|
|
Baizhou Zhang
|
ecb786c8d7
|
[Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268)
|
2026-05-06 18:59:01 -07:00 |
|
|
Liangsheng Yin
|
eaf074d50e
|
propagate pytest exit code from test __main__ entries (#24487)
|
2026-05-06 18:46:52 -07:00 |
|
|
huangtingwei
|
27445f9836
|
Add ChatCompletionRequest-style support to /v1/tokenize (#23981)
|
2026-05-06 18:35:20 -07:00 |
|
|
Baizhou Zhang
|
9e1336d406
|
[Misc] Fix breaking weight checker test (#24553)
|
2026-05-06 15:42:54 -07:00 |
|
|
Alison Shao
|
e72246c6e6
|
ci: bump test_mimo_models.py est_time 330 → 610 (#24551)
|
2026-05-06 14:35:43 -07:00 |
|
|
jsheng_LinkedinandClaude Opus 4.7
|
bc70488695
|
[CI] Temporarily disable marco/mcdse-2b-v1 in test_embedding_models (#24279)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-06 14:28:39 -07:00 |
|
|
Lianmin Zheng
|
b859f7ffba
|
Improve metrics, observability, and PD deploy tooling (#24521)
|
2026-05-06 11:27:35 -07:00 |
|
|
fzyzcjy
|
c4c5541618
|
Support getting checksums in weight checker (#24537)
|
2026-05-06 22:59:28 +08:00 |
|
|
fzyzcjy
|
800deaaefa
|
Add unit and end-to-end tests for weight checker (#24536)
|
2026-05-06 22:48:48 +08:00 |
|
|
Ke Baoandhzh0425
|
eb5f0fbeef
|
Support swa HiCache for unified radix cache (#23391)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-05-06 22:19:25 +08:00 |
|
|
fzyzcjy
|
11b0e510aa
|
Fix lint (#24520)
|
2026-05-06 18:26:41 +08:00 |
|
|
fzyzcjy
|
a858fda708
|
Add e2e test with log snapshot in dumper grafter (#24513)
|
2026-05-06 17:00:13 +08:00 |
|
|
fzyzcjy
|
8527db0a91
|
Enhance diff and tensor-info logging in dumper grafter (#24512)
|
2026-05-06 16:58:08 +08:00 |
|
|
fzyzcjy
|
75943cfbcf
|
Support per-call extras and dataclass transform input in dumper grafter (#24511)
|
2026-05-06 16:57:44 +08:00 |
|
|
fzyzcjy
|
833279eb2e
|
Support multi-rank exchange via all_gather_object in dumper grafter (#24510)
|
2026-05-06 16:57:20 +08:00 |
|
|
fzyzcjy
|
ebd64f5d40
|
Support user-supplied recv-side transform in dumper grafter (#24509)
|
2026-05-06 16:56:52 +08:00 |
|
|
fzyzcjy
|
9a65f0ac26
|
Support t2b direction and overlap protection in dumper grafter (#24508)
|
2026-05-06 16:56:24 +08:00 |
|
|
fzyzcjy
|
58487e68e5
|
Support cross-system tensor grafting in dumper (#24507)
|
2026-05-06 16:55:40 +08:00 |
|
|
fzyzcjy
|
61104d7d0a
|
Add prefixed _log helper in dumper (#24506)
|
2026-05-06 16:54:20 +08:00 |
|
|
|
b2420d72ff
|
[RL] DeepEP support for --enable-return-routed-experts (#16859)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Junrong Lin <33685709+ocss884@users.noreply.github.com>
|
2026-05-05 20:01:07 -07:00 |
|
|
Jianhong Zhang
|
c7019ff33d
|
[NIXL][XPU] Use np.uint64 for pointer/length arrays in disaggregation KV transfer (#24188)
|
2026-05-06 10:09:03 +08:00 |
|
|
|
08d4c2072b
|
move topk capturers to srt/state_capturer/ (#24450)
Co-authored-by: Yueming Yuan <yym022502@gmail.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
Co-authored-by: Ziang Li <ziangli@umich.edu>
|
2026-05-05 15:54:01 -07:00 |
|
|
Liangsheng Yin
|
47a416fc62
|
add indexer-topk capture (V3.2 NSA + infra) (#24392)
|
2026-05-05 15:05:15 -07:00 |
|
|
Zhangheng
|
e299ec1bff
|
[UnifiedRadixTree]: Fix flaky ci (#24421)
|
2026-05-05 20:22:19 +08:00 |
|
|
Khoa Pham
|
d22853480d
|
Fix deterministic inference on models with SWAKVPool (#24395)
|
2026-05-05 20:20:46 +08:00 |
|
|
Michael
|
244531bc4f
|
[AMD] Add Kimi-K2.6 in nightly tests for MI30x and MI35x (#23848)
|
2026-05-04 23:37:14 -07:00 |
|
|
Vladislav Nosivskoy
|
60a1dacd89
|
[HiCache] return cached_tokens_details in sglext for streaming responses (#22055)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
|
2026-05-04 12:30:17 -07:00 |
|
|
Zhangheng
|
05aed5e1d5
|
[UnifiedRadixTree]: Add KL accuracy CI for UnifiedTree with HiCache (#24346)
|
2026-05-04 20:18:10 +08:00 |
|
|
|
952b3caf18
|
feat: use structural tags to enable strict tool calling and reasoning for more models (#21722)
Signed-off-by: Yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-05-04 02:30:28 -07:00 |
|
|
Khoa Pham
|
ef2b1b6d89
|
Fix flashinfer workspace OOM (#24172)
|
2026-05-04 01:26:35 -07:00 |
|
|
Bingxu ChenandYC Yen-Ching Tseng
|
5eff3c489a
|
[AMD] Deepseek v4 Flash / Pro nightly tests for MI35x ROCm 7.2 (#24203)
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
|
2026-05-04 00:02:33 -07:00 |
|
|
Ke Bao
|
aea527afdc
|
Fix swa chunk req deferred (#24318)
|
2026-05-04 14:52:15 +08:00 |
|
|
ZhanghengandShangming Cai
|
9a5450ad73
|
[PD]: Support incremental transfer for mooncake transfer engine (#24257)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-04 00:57:59 +08:00 |
|
|
|
c0f5950636
|
[UnifiedRadixTree]: Support HiCache Framework for UnifiedRadixTree (#23316)
Co-authored-by: JINZ <1023553676@qq.com>
Co-authored-by: diemchai <diemchai@tencent.com>
|
2026-05-03 22:13:22 +08:00 |
|
|
ZhanghengandShangming Cai
|
44ca2d01fc
|
[pd]: (Bug Fix) Incorrect out_cache_loc slicing in prepare_for_prebuilt (#24230)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-03 18:35:16 +08:00 |
|
|
Glen Liu
|
76b9c8de6f
|
[Feature] add LoRADrainer to address high P99 TTFT (#17913)
|
2026-05-02 16:13:43 -07:00 |
|
|
|
88bb5dffe4
|
[Dependency] Upgrade to Torch 2.11.0 (#21247)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-05-02 12:25:36 -07:00 |
|
|
egvenediktovandronnie_zheng
|
83bf5d6869
|
[NPU]TP Communications compression For Qwen3 models for NPU (#20520)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-02 14:29:11 +03:00 |
|
|
|
ebbaab5597
|
[NPU] Add GitHub test summary and deduplicate test code. Part 1 (#23835)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-02 14:18:18 +03:00 |
|
|
billishyahao
|
b939d5410f
|
[AMD] enable sdma for moriep unittest (#24259)
|
2026-05-01 23:34:53 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.7
|
cd27baaffd
|
[ci][cu13] Bump torch_memory_saver to 0.0.9.post1; restore manual tests (#23182)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-01 22:50:38 -07:00 |
|
|
|
d41e8c459d
|
Support RunAI loading for quantized checkpoints (#23850)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Sam Shleifer <sam@thinkingmachines.ai>
|
2026-05-02 11:11:40 +08:00 |
|
|
Cheng Wan
|
b47fab6f5d
|
[bugfix] Support MIXED forward mode in TBO splitter for DP attention (#24241)
|
2026-05-01 16:01:23 -07:00 |
|
|
Lianmin Zheng
|
ece8a1a788
|
Refactor device timer, clean up metrics collector, and add fwd occupancy metric (#24197)
|
2026-05-01 10:25:25 -07:00 |
|
|
|
4a50cd781e
|
[BugFix][HiMamba] Fix host-protected node deletion in HiMamba tombstone del (#23696)
Co-authored-by: diemchai <diemchai@tencent.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-05-01 21:57:47 +08:00 |
|
|
ishandhanani
|
5b7ce417d0
|
[P/D disagg] - support decode side radix cache (#19746)
|
2026-05-01 21:55:34 +08:00 |
|
|
Qiaolin Yu
|
4197c55968
|
[spec decoding] add tests for chain-style multi layer eagle + return_logprob (#24192)
|
2026-05-01 01:48:48 -07:00 |
|
|
billishyahao
|
a578bf814c
|
[AMD] fix moriep unittest failure (#24205)
|
2026-04-30 23:36:20 -07:00 |
|