 Yuhao Yang
|
aea0e30853
|
[4/N] Qwen3.5Opt: Overlap mamba verify update with draft extend (#26924)
|
2026-06-13 20:29:20 +08:00 |
|
|
Yuhao YangandXinyuan Tong
|
50815d54a7
|
docs (#28061)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-06-12 21:19:40 +08:00 |
|
|
Yuhao Yang
|
46c58b5c70
|
bench: fix MMMU VLM eval max_tokens for CoT prompt (#27327)
|
2026-06-05 10:28:16 +08:00 |
|
|
Yuhao Yang
|
a8cfae0b30
|
doc: update step-3.7-flash docker image tag (#26625)
|
2026-05-29 08:40:17 +08:00 |
|
|
|
3bdea78ad1
|
model: support Step-3.7-Flash (#26565)
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>
|
2026-05-29 08:00:54 +08:00 |
|
|
Yuhao YangandKe Bao
|
c9153da5dc
|
Fix SWA double-free in disagg decode with MTP speculation (#25805)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-05-22 00:28:54 -07:00 |
|
|
Yuhao YangandYaochen Han
|
fa6f4dfb35
|
improve: combine vit calls for images from different reqs from one batch (#25910)
Co-authored-by: Yaochen Han <814073252@qq.com>
|
2026-05-22 14:57:41 +08:00 |
|
|
Yuhao Yang
|
81d686d9fa
|
Default MegaMoE to W4A8 for Max-Throughput recipe (#26004)
|
2026-05-21 11:54:16 -07:00 |
|
|
Yuhao Yang
|
79ea30d1f1
|
[Bug] Fix V4-Pro NaN on Blackwell by converting fp8_einsum input scale to ue8m0 (#25733)
|
2026-05-18 23:48:34 -07:00 |
|
|
Yuhao Yang
|
d8e66e54e5
|
fix: use triton_attn as default vision attention on B300 (SM103) (#25570)
|
2026-05-19 11:00:07 +08:00 |
|
|
Yuhao Yang
|
57eb5bdaf6
|
[Doc] DSV4 cookbook: clean up env vars, add MegaMoE toggle, unify docker image (#25412)
|
2026-05-16 11:28:05 -07:00 |
|
|
Yuhao Yang
|
b2c6db0cc4
|
[MoE] Decouple Mega MoE from DeepEP backend (#25406)
|
2026-05-16 00:18:43 -07:00 |
|
|
Yuhao Yang
|
18c16f8660
|
Port SGLANG_OPT_SWA_EVICT_DROP_PAGE_MARGIN from deepseek_v4_dev (#25419)
|
2026-05-15 17:39:13 -07:00 |
|
|
|
5ba69f50fb
|
Add multi-detokenizer support (#24944)
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-15 17:26:26 -07:00 |
|
|
Yuhao Yang
|
88d3ed7df1
|
Enable SGLANG_OPT_FP8_WO_A_GEMM by default (#25181)
|
2026-05-15 02:09:13 +08:00 |
|
|
Yuhao Yang
|
37f030a0de
|
[MoE] Decouple Mega MoE from DeepEP backend (#24884)
|
2026-05-15 02:01:44 +08:00 |
|
|
|
e2290b155a
|
Port KV Compression V2 from deepseek_v4_dev (#24890)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-05-13 22:40:38 +08:00 |
|
|
|
d0913fca8d
|
Port fused SiLU+clamp+FP8 quant from DSV4 dev branch (#24897)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: zcnrex <zcnrex@gmail.com>
|
2026-05-13 22:36:44 +08:00 |
|
|
|
d6d3d0f599
|
Optimize SWA memory preallocation for disaggregated decode (#24857)
Co-authored-by: weireweire <weiliangl@nvidia.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
|
2026-05-13 09:09:34 +08:00 |
|
|
|
2f06867128
|
Optimize MHC pipeline: DeepGemm, fused norm, fused hc_head (#24775)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
|
2026-05-10 19:03:37 +08:00 |
|
|
Yuhao YangandCheng Wan
|
bd0aa22309
|
Fix PD bootstrap failure handling (#24772)
Co-authored-by: Cheng Wan <chwan@rice.edu>
|
2026-05-10 19:02:47 +08:00 |
|
|
Yuhao Yang
|
09912fd89d
|
Remove unnecessary bf16 assert in rotate_activation (#24686)
|
2026-05-09 05:00:52 +08:00 |
|
|
Yuhao YangandClaude Opus 4.6
|
6279aee716
|
[docs] Update B300 Pro cookbook with accuracy-verified serving configs (#24367)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-05-05 07:26:03 +01:00 |
|
|
Yuhao Yang
|
b437f6be48
|
model: Nemotron-omni-v3-alias (#23857)
|
2026-04-29 11:08:23 +08:00 |
|
|
Yuhao Yang
|
4e1ef6b3cf
|
[Docs] Add single-node H200 DeepSeek-V4-Pro low-latency recipe (#23943)
|
2026-04-28 23:03:26 +08:00 |
|
|
Yuhao Yang
|
049f1bf6fb
|
docs(DeepSeek-V4): add GB200 platform to cookbook recipe (#23725)
|
2026-04-25 20:54:55 -07:00 |
|
|
Yuhao Yangandtrangdough
|
4a3fe2a091
|
model: support parakeet nemotron encoder (#23568)
Co-authored-by: trangdough <trangtdo22@gmail.com>
|
2026-04-25 11:00:23 +08:00 |
|
|
Yuhao Yang
|
f41f1a74a4
|
[diffusion] chore: support custom output folder name in GT generation workflow (#23422)
|
2026-04-22 11:18:21 +08:00 |
|
|
Yuhao Yang
|
5595f6e988
|
Fix trtllm mla chunked-prefill zero-length bug (#22291) (#22688)
|
2026-04-20 22:10:13 -07:00 |
|
|
|
fe9b9b254b
|
Fix segfault in cudaMemcpyBatchAsync on CUDA 13.0 (#23136)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2026-04-20 12:20:22 -07:00 |
|
|
Yuhao Yang
|
a77abbe005
|
[VLM] Reduce GPU memory footprint of CUDA IPC MM feature transport (#22662)
|
2026-04-17 10:38:36 +08:00 |
|
|
Yuhao Yang
|
9da998a882
|
[diffusion] feat: disaggregated diffusion (#21701)
|
2026-04-16 23:51:32 +08:00 |
|
|
Yuhao Yang
|
b8794baa6d
|
[Step3p5] Optimize allreduce in MoE layers (#22773)
|
2026-04-16 09:33:12 +08:00 |
|
|
Yuhao Yang
|
8686f42acb
|
[VLM] Enable per-image ViT cache and avoid TP CUDA context creation for Kimi-K2.5 (#22858)
|
2026-04-16 01:14:24 +08:00 |
|
|
Yuhao Yang
|
16f306fd85
|
[VLM] GPU Image Preprocessing for Kimi-K2.5 (#22368)
|
2026-04-11 11:13:30 +08:00 |
|
|
Yuhao Yang
|
f5fd5ab622
|
add whisper test (#22302)
|
2026-04-10 15:34:53 +08:00 |
|
|
Yuhao YangandMick
|
2b119ba388
|
[diffusion] fix: fix accuracy for flux series (#22059)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-04-05 16:03:17 +08:00 |
|
|
Yuhao Yang
|
34d5765e2f
|
[VLM] Chunk-aware ViT encoding with per-image cache and lazy device transfer (#22038)
|
2026-04-04 16:55:17 +08:00 |
|
|
Yuhao Yang
|
69e89a1fcc
|
[VLM] Enable per-image MM splitting by default and remove MULTI_IMAGES modality (#21899)
|
2026-04-03 11:04:41 +08:00 |
|
|
Yuhao Yang
|
2ef12073f4
|
[VLM] Add VLM TP=4 per-commit CI test and improve MMMU eval prompt/parser (#21841)
|
2026-04-01 20:09:47 -07:00 |
|
|
Yuhao Yang
|
1aabe44b64
|
[VLM] remove AsyncMMDataProcessor wrapper (#21651)
|
2026-04-01 17:39:50 +08:00 |
|
|
Yuhao Yang
|
68a4573627
|
[diffusion] fix: fix Flux.2 with tp(#21664)
|
2026-03-31 14:14:59 +08:00 |
|
|
Yuhao Yang
|
4e69f14b95
|
fix bench_serving sglang backend to support image dataset (#21294)
|
2026-03-29 10:02:11 +08:00 |
|
|
Yuhao Yang
|
57cf4790ca
|
[VLM] Optimize ShmPointerMMData for multi-pickle safety and deferred unwrap (#21465)
|
2026-03-28 23:11:12 +08:00 |
|
|
Yuhao Yang
|
5ef56682b8
|
reduce CPU peak memory in multimodal tensor hashing (#21123)
|
2026-03-28 11:09:16 +08:00 |
|
|
Yuhao Yang
|
32a85ef128
|
[diffusion] CI: auto-skip diffusion tests when required pipeline class is missing from diffusers (#21139)
|
2026-03-23 12:15:21 +08:00 |
|
|
Yuhao Yang
|
c32e35a2a5
|
[diffusion] CI: fix picklingerror for diffusion models using diffusers backend (#20854)
|
2026-03-22 11:51:03 +08:00 |
|
|
Yuhao Yang
|
24a27d5320
|
vlm: support piecewise cuda graph for Kimi-K2.5 (#20747)
|
2026-03-18 00:32:07 +08:00 |
|
|
Yuhao Yang
|
2ccdb7373e
|
[diffusion] CI: fix consistency test workflow (#20704)
|
2026-03-17 07:42:30 +08:00 |
|
|
Yuhao Yangandwili-65535
|
1c456a0af5
|
VLM: add Conv2dLayer/Conv3dLayer to fix PyTorch 2.9.1 CuDNN Conv3d (#20282)
Co-authored-by: wili-65535 <wili-65535@users.noreply.github.com>
|
2026-03-15 19:17:44 +08:00 |
|
|
Yuhao Yang
|
a6ecf050be
|
diffusion: fix helios accuracy issue (#20036)
|
2026-03-15 13:55:51 +08:00 |
|
|
Yuhao Yang
|
a57a44739f
|
[diffusion] deps: upgrade diffusers from 0.36.0 to 0.37.0 (#20318)
|
2026-03-12 19:17:28 +08:00 |
|
|
Yuhao Yang
|
ecca8c553d
|
[diffusion] fix: fix diffusers backend issues in diffusion ci gt workflow (#20173)
|
2026-03-10 00:51:48 +08:00 |
|
|
Yuhao Yang
|
1cb86f5171
|
[diffusion] CI: fix CI script path and missing server arg in perf baseline generator (#20138)
|
2026-03-09 10:35:21 +08:00 |
|
|
Yuhao Yang
|
57f28fda90
|
[diffusion] chore: add diffusion new model skill (#19605)
|
2026-03-09 09:45:23 +08:00 |
|
|
Yuhao Yang
|
115f879958
|
Helios: Real Real-Time Long Video Generation Model (#19782)
|
2026-03-04 14:58:04 +08:00 |
|
|
Yuhao Yang
|
ca44aa25af
|
Fix dp_attention crash when dp_size < tp_size in warmup dummy run (#19760)
|
2026-03-03 19:43:13 -08:00 |
|
|
Yuhao YangandProzac614
|
b01b07aa16
|
[diffusion] CI: GT generation flow for diffusion CI (#19236)
Co-authored-by: Prozac614 <dwt614707404@163.com>
|
2026-02-28 14:07:45 +08:00 |
|
|
Yuhao Yangandyizhang2077
|
c7c4a1cbbd
|
refactor linear attention backend (#18622)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2026-02-25 23:02:44 +08:00 |
|
|
Yuhao Yang
|
5a7ae059e3
|
Add DP ViT support for Kimi K2.5 (#18689)
|
2026-02-18 23:03:07 +08:00 |
|
|
Yuhao Yangandltd0924
|
980d2936cd
|
model: support Step-3.5-Flash (#18084)
Co-authored-by: ltd0924 <ltd0924@sina.com>
|
2026-02-03 00:40:07 +08:00 |
|
|
Yuhao Yang
|
d11ccc0a0a
|
fix: avoid double reduce in VLM dp attention (#17991)
|
2026-02-02 09:44:32 +08:00 |
|
|
Yuhao Yang
|
3c2f4c7bbe
|
[diffusion] model: sync with upstream z-Image (#17822)
|
2026-01-29 21:10:11 +08:00 |
|
|
Yuhao YangandMick
|
479ab7a4e7
|
model: support Kimi-K2.5 (#17789)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-01-27 10:57:00 +08:00 |
|
|
Yuhao Yang
|
f7a0bcda1e
|
model: step3-vl-10b (#17513)
|
2026-01-22 23:15:08 +08:00 |
|
|
Yuhao Yangandjianyingzhu
|
a0b4ba9032
|
[diffusion] model: GLM-Image (#16894)
Co-authored-by: jianyingzhu <53300651@qq.com>
|
2026-01-14 02:02:03 +08:00 |
|
|
Yuhao YangandMick
|
e14f5ec8a8
|
[diffusion] refactor: eliminate redundant parameters in req (#16505)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-01-08 11:14:03 +08:00 |
|
|
Yuhao Yang
|
10174e1114
|
Revert "[grpc] update api to scheduler in grpc request manager" (#16387)
|
2026-01-04 22:05:39 -08:00 |
|
|
Yuhao Yang
|
2138ff48c6
|
Revert "[FEAT] optimize tensor zmq transfer for multimodal inputs" (#16386)
|
2026-01-04 22:05:26 -08:00 |
|
|
Yuhao Yang
|
6c8587b5db
|
[diffusion] fix: align negative prompt with official readme for new model (#16222)
|
2026-01-02 15:20:56 +08:00 |
|
|
Yuhao YangandMick
|
4280a18a13
|
[diffusion] CI: add test for cache-dit (#16204)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-31 19:58:10 +08:00 |
|
|
Yuhao YangandMick
|
39ca57cd28
|
[diffusion] chore: tiny fix model config (#16159)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-30 22:11:38 +08:00 |
|
|
Yuhao Yang
|
0cd2b719a5
|
[diffusion] chore: remove useless params (#15925)
|
2025-12-28 01:01:08 +08:00 |
|
|
Yuhao Yang
|
29ce7b3612
|
[diffusion] chore: remove stepvideo code (#15918)
|
2025-12-27 13:25:05 +08:00 |
|
|
Yuhao Yang
|
ba41080892
|
[diffusion] model: support qwen-image-edit-2511 (#15458)
|
2025-12-19 20:06:00 +08:00 |
|
|
Yuhao Yang
|
3d42b7e7b0
|
unified management of environment variables for vlm cuda ipc transport (#14501)
|
2025-12-18 12:28:06 +08:00 |
|
|
Yuhao Yang
|
01b955ac3d
|
[diffusion] model: support mutli-image input and qwen-image-edit-2509 (#15005)
|
2025-12-15 16:17:10 +08:00 |
|
|
Yuhao Yang
|
a81cc1b8b3
|
add transformers version validation for glm-4.6v moe models (#14998)
|
2025-12-13 10:54:08 -08:00 |
|
|
Yuhao Yang
|
06b58c5dc5
|
fix flaky image access in ci by switching to raw content url (#14940)
|
2025-12-13 10:52:06 -08:00 |
|
|
Yuhao Yang
|
b62fe8504c
|
fix nightly vlm ci : restore original eval for requests without regex (#14875)
|
2025-12-10 23:13:25 -08:00 |
|
|
Yuhao Yang
|
c1bd5ee8c5
|
Revert transformers to 4.57.1 (#14801)
|
2025-12-10 11:04:36 -08:00 |
|
|
Yuhao Yang
|
02f1e81e2d
|
Revert "fix: checking if tokenizer is in cache before downloading from HF" (#14808)
|
2025-12-10 01:14:35 -08:00 |
|
|
Yuhao Yang
|
793c98afaf
|
handling incomplete rope_scaling config ci after transformers upgrade (#14784)
|
2025-12-09 22:56:16 -08:00 |
|
|
Yuhao Yang
|
15bc8cbd74
|
fix rope parameter initialization error caused by transformers v5.0 update (#14745)
|
2025-12-09 10:51:26 -08:00 |
|
|
Yuhao Yang
|
b9bef31a15
|
fix: use .get() when accessing strict mem-check env variable (#14657)
|
2025-12-08 13:25:42 -08:00 |
|
|
Yuhao Yang
|
8200fb56cb
|
update transformers package version to 5.0.0rc0 (#14356)
|
2025-12-08 22:46:01 +08:00 |
|
|
Yuhao Yang
|
f72a77038f
|
modify the sgl-kernel to be compatible with transformers 5.x. (#14625)
|
2025-12-08 00:39:00 -08:00 |
|
|
Yuhao Yang
|
7b0c7ad163
|
Revise DP Multi-Modal Encoder Document (#14290)
|
2025-12-06 12:56:53 +08:00 |
|
|
Yuhao Yang
|
0b9dbea593
|
[diffusion] chore: improve z-image (#14104)
|
2025-12-01 12:26:17 +08:00 |
|
|
Yuhao Yang
|
f03ea34a3d
|
add runtime check for PyTorch 2.9.1 + CuDNN < 9.15 to prevent Conv3d performance issues (#14119)
|
2025-11-29 10:05:54 -05:00 |
|
|
Yuhao Yang
|
841eb29d3d
|
[diffusion] model: support z-image (#14067)
|
2025-11-28 21:48:31 +08:00 |
|
|
Yuhao Yang
|
5795da5e83
|
[diffusion] fix: fix the issue where the qwen-edit & wan model produces incorrect output during sequence parallelism (#13922)
|
2025-11-26 15:58:23 +08:00 |
|
|
Yuhao YangandMick
|
e5c0f59133
|
[diffusion] CI: send nightly-test outputs of diffusion to slack for correctness monitoring (#13833)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-24 15:22:26 +08:00 |
|
|
Yuhao YangandMick
|
dd303614e0
|
[diffusion] CI: tinyfix diffusion ci (#13769)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-23 01:03:36 +08:00 |
|
|
Yuhao YangandMick
|
a22de641ef
|
[diffusion] fix: fix hunyuanvideo and add 2-gpu ci test (#13720)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-22 20:54:51 +08:00 |
|
|
Yuhao YangandMick
|
8c212a2029
|
[difusion] CI: speed up multimodal_gen ci (#13665)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-21 14:26:33 +08:00 |
|
|
Yuhao Yang
|
7119d188f6
|
[CI] re-enable test_vision_openai_server_a ci (#13444)
|
2025-11-17 18:32:59 -08:00 |
|
|
Yuhao YangandMick
|
6afe396399
|
diffusion: support fa4 in fa backend for blackwell (#13263)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-16 21:02:45 +08:00 |
|
|
Yuhao Yang
|
1240ac13b8
|
vlm: fix tiny multimodal cache bug (#12984)
|
2025-11-10 21:30:19 +08:00 |
|
|
Yuhao YangandMick
|
d8736c756a
|
fix multimodal gen issues (#12765)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-07 13:19:49 +08:00 |
|