 Yi ZhangandKe Bao
|
66a7fd5c0b
|
refactor: mamba radix cache server args initialize (#28151)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-06-18 13:02:36 -07:00 |
|
|
Yi Zhang
|
b168723424
|
[BUGFIX] fix bug in handle mamba radix cache in server_args (#18723)
|
2026-02-12 21:33:32 +08:00 |
|
|
Yi Zhang
|
5844cb2fd8
|
refactor mamba radix cache logic in server_args (#17645)
|
2026-01-26 17:02:49 +08:00 |
|
|
Yi Zhang
|
1b97fa769b
|
[BUGFIX] fix value oom in radix tree (#17400)
|
2026-01-21 17:12:57 +08:00 |
|
|
Yi Zhang
|
236772c0e1
|
[RadixTree][2/N Refactor]: swa cache init tiny refactor (#17397)
|
2026-01-21 15:48:30 +08:00 |
|
|
Yi ZhangandLiangsheng Yin
|
737a1183d6
|
[BUGFIX] fix radix cache memory consumption to avoid OOM (#17191)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2026-01-17 16:47:37 +08:00 |
|
|
Yi ZhangandHanming Lu
|
7fc12e0bfa
|
support page size large than 64 for mamba radix cache (#16657)
Co-authored-by: Hanming Lu <hanming@x.ai>
|
2026-01-07 22:52:24 +08:00 |
|
|
Yi Zhang
|
a3914e3b3f
|
[Bugfix] fix some memory computation bugs for qwen3next with mtp (#16138)
|
2026-01-05 23:24:21 +08:00 |
|
|
Yi Zhang
|
ef92b4eb88
|
[BUGFIX] fix edge case for qwen3-next (#14209)
|
2025-12-26 17:14:37 +08:00 |
|
|
Yi Zhang
|
eb3da9c1dd
|
fuse ssm state store into chunk_gated_delta_rule_fwd_h (#15409)
|
2025-12-25 16:03:15 +08:00 |
|
|
Yi Zhang
|
9d4f066fb9
|
Add doc for qwen3 next (#15337)
|
2025-12-17 17:53:07 -08:00 |
|
|
Yi ZhangandMick
|
1f7fcc10d5
|
[diffusion] profile: fix profiling bugs (#13642)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-25 17:58:35 +08:00 |
|
|
Yi Zhang
|
a3e4fe4b41
|
refactor linear memory pool (#13004)
|
2025-11-17 16:24:29 +08:00 |
|
|
Yi Zhang
|
8db7fc4186
|
disable overlap schedule if mamba radix cache open (#13057)
|
2025-11-11 16:35:38 +08:00 |
|
|
Yi Zhang
|
6a1a64fa41
|
[BUGFIX] fix output_ids in abort (#12737)
|
2025-11-05 22:51:47 -08:00 |
|
|
Yi Zhang
|
e2715cf871
|
fix mamba prefix cache leak caused by abort (#12693)
|
2025-11-05 22:51:03 -08:00 |
|
|
Yi Zhang
|
21a8fa16ea
|
tiny optimize for bench serving (#12553)
|
2025-11-03 14:13:18 -08:00 |
|
|
|
a55cf5304a
|
[Feature] Support mamba radix cache v0 (#11214)
Co-authored-by: hanming-lu <hanming@x.ai>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: thalahors <ericalcaide1@gmail.com>
|
2025-10-12 20:57:15 -07:00 |
|
|
Yi Zhang
|
4b15fa00f0
|
move fla env check position (#11500)
|
2025-10-12 06:40:45 -07:00 |
|
|
Yi Zhang
|
1344ebc833
|
support qwen3-next-fp8 deepep (#10622)
|
2025-09-18 11:36:22 -07:00 |
|
|
Yi Zhang
|
e07b21ceaf
|
update deepep version for qwen3-next deepep moe (#10624)
|
2025-09-18 11:35:22 -07:00 |
|
|
Yi Zhang
|
db71c38fcd
|
Scale kkt after reduction (#10604)
|
2025-09-18 20:51:40 +08:00 |
|
|
Yi Zhang
|
297d374510
|
support qwen3_next blackwell (#10403)
|
2025-09-13 17:18:26 +08:00 |
|
|
Yi Zhangandtazjin
|
151e287d1a
|
fix: add fast path for function call (#9023)
Co-authored-by: tazjin <mail@tazj.in>
|
2025-09-12 10:28:54 -07:00 |
|
|
Yi Zhang
|
fe6cdf8972
|
add qwen3-next ut (#10355)
|
2025-09-12 18:06:48 +08:00 |
|
|
Yi Zhang
|
27778010fc
|
fix dual stream bug (#10352)
|
2025-09-11 20:53:42 -07:00 |
|
|
Yi Zhang
|
760b788a58
|
add qwen3-next doc (#10327)
|
2025-09-11 14:29:11 -07:00 |
|
|
Yi Zhangandcao1zhg
|
ab795ae840
|
add h20 qwen3 next config (#10264)
Co-authored-by: cao1zhg <114661107+cao1zhg@users.noreply.github.com>
|
2025-09-11 14:02:24 -07:00 |
|
|
|
30c6e1f569
|
Qwen3-Next support (#10233)
Co-authored-by: cao1zhg <114661107+cao1zhg@users.noreply.github.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: qingquansong <ustcsqq@gmail.com>
Co-authored-by: Yaoyao Ding <dingyaoyao.cs@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
|
2025-09-11 04:11:49 -07:00 |
|
|
Yi Zhang
|
dc491b399d
|
add flash linear attention triton kernel (#10239)
|
2025-09-10 21:47:20 -07:00 |
|
|
Yi Zhang
|
9e2f7252db
|
add dual stream for qwen2_moe (#10252)
|
2025-09-10 12:49:43 -07:00 |
|
|
Yi Zhang
|
8cbe1538ef
|
Add mamba kernel (#10234)
|
2025-09-09 12:58:43 -07:00 |
|
|
Yi Zhang
|
89f1d4f536
|
update deepep commit to support qwen3-coder (#9066)
|
2025-08-11 10:42:33 -07:00 |
|
|
Yi Zhang
|
8c298031d5
|
refactor llama4 dp attention logic (#7729)
|
2025-07-03 22:48:11 -07:00 |
|
|
|
489934be0a
|
fuse renormal into moe topk softmax kernel python code (#7751)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-07-03 16:22:14 -07:00 |
|
|
Yi Zhangandispobock
|
2998c4bdf4
|
[optimize] fuse renormalize into moe_topk_softmax (#7744)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2025-07-03 12:42:44 -07:00 |
|
|
Yi Zhangandispobock
|
264dc6e744
|
[optimize] add two stream norm for qwen3 (#7740)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2025-07-03 09:59:17 -07:00 |
|
|
Yi Zhang
|
646cef2e2e
|
support qwen3 dense model dp attention (#7681)
|
2025-07-03 09:58:20 -07:00 |
|
|
Yi Zhang
|
93b6785d78
|
add description for llama4 eagle3 (#7688)
|
2025-07-01 01:19:19 -07:00 |
|
|
Yi Zhang
|
3cee035e99
|
add fused moe config for qwen3 in triton3.3.1 (#7445)
|
2025-06-22 18:29:25 -07:00 |
|
|
Yi Zhang
|
b18416fbf8
|
Fix qwen3 tbo/dp-lm-head (#6652)
|
2025-05-27 00:38:27 -07:00 |
|
|
Yi Zhang
|
14d1075f2c
|
fix qwen3moe eplb prefill bug (#6617)
|
2025-05-26 02:15:21 -07:00 |
|
|
Yi Zhang
|
f9bab3d591
|
qwen3moe support two batch overlap (#6598)
|
2025-05-25 23:08:16 -07:00 |
|
|
Yi Zhang
|
65f091310c
|
refactor qwen moe code, use communicator to support tp+dp (#6581)
|
2025-05-25 23:01:10 -07:00 |
|
|
Yi Zhang
|
e6f113569e
|
support eplb for qwen3 (#6533)
|
2025-05-23 18:31:30 -07:00 |
|
|
Yi Zhang
|
b06215daed
|
[BUG] fix stop_profile crash (#6431)
|
2025-05-19 17:30:33 -07:00 |
|
|
Yi Zhang
|
d50e36a79d
|
support vlm benchmark profile (#5905)
|
2025-04-29 23:48:27 -07:00 |
|
|
Yi Zhang
|
a0251a3fd6
|
add fused moe config for qwen3moe fp8/bf16 (#5849)
|
2025-04-28 11:55:52 -07:00 |
|
|
Yi Zhang
|
1f963d7f64
|
Bugfix for minicpmo vision test (#5760)
|
2025-04-26 23:18:02 +08:00 |
|
|
Yi Zhang
|
ebf495f013
|
sgl-kernel use cutlass latest version for fp8 blockwise gemm (#5207)
|
2025-04-09 11:47:04 -07:00 |
|
|
Yi Zhang
|
aba5ca154d
|
python transfer custom allreduce from trt kernel to vllm kernel (#5080)
|
2025-04-05 15:35:55 -07:00 |
|
|
Yi Zhang
|
bcbbf519f9
|
sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079)
|
2025-04-05 14:23:20 -07:00 |
|
|
Yi Zhang
|
5ec5eaf760
|
fix allreduce test (#4909)
|
2025-03-29 23:16:53 -07:00 |
|
|
Yi Zhang
|
3c09548d1f
|
close gemma2 in test_verl_engine.py temporarily (#4685)
|
2025-03-22 16:36:46 -07:00 |
|
|
Yi Zhang
|
25e1816eff
|
fix custom allreduce performance/accuracy problem (#4477)
|
2025-03-16 12:16:30 -07:00 |
|
|
yizhang2077
|
1eb8eade2b
|
add control for cutlass fp8 blockwise gemm (#3727)
|
2025-02-20 16:10:35 +08:00 |
|
|
yizhang2077
|
98eecbda54
|
integrate blockwise fp8 kernel (#3529)
|
2025-02-13 04:39:33 +08:00 |
|
|
yizhang2077
|
640363ad20
|
support blockwise fp8 matmul kernel (#3267)
|
2025-02-13 01:49:33 +08:00 |
|
|
yizhang2077
|
1e3e521544
|
add unit test for block wise fp8 (#3156)
|
2025-01-27 15:32:04 +08:00 |
|
|
yizhang2077
|
98522149ff
|
mirror fix for custom allreduce (#3124)
|
2025-01-25 18:26:41 +08:00 |
|
|
yizhang2077
|
24cafe3177
|
add config to swtich from vllm custom allreduce to sgl_kernel custom allreduce (#2981)
|
2025-01-19 22:30:38 +08:00 |
|
|
yizhang2077
|
767c9dec03
|
adapt custom allreduce for tensorrt llm (#2511)
|
2025-01-16 04:57:35 +08:00 |
|
|
yizhang2077
|
6cb3974e77
|
optimize custom allreduce kernel (#2904)
|
2025-01-16 03:04:25 +08:00 |
|
|
yizhang2077
|
3900a94afe
|
Support twoshot kernel (#2688)
|
2025-01-06 00:47:16 +08:00 |
|
|
yizhang2077andYineng Zhang
|
e04d3f2897
|
adapt tensorrt llm custom all reduce to sgl-kernel (#2481)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2024-12-15 13:15:59 +08:00 |
|
|
yizhang2077andYineng Zhang
|
d5b95cbb53
|
adapt vllm distributed module to sglang (#2244)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2024-12-01 15:54:52 +08:00 |
|
|
yizhang2077
|
a8aad9357d
|
qwen2vl fix bug for #1971 #1897 (#1984)
|
2024-11-10 08:10:45 -08:00 |
|
|
yizhang2077andByron Hsu
|
d04899d7ca
|
stop_str of qwen2-vl template should be a tuple not a str (#1834)
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
|
2024-10-29 20:30:41 +00:00 |
|
|
yizhang2077
|
def55bc876
|
Qwen2vl support cuda graph and disable radix cache (#1780)
|
2024-10-25 10:45:17 -04:00 |
|
|
yizhang2077
|
554fbf93cd
|
[Bugfix] qwen2vl forward_extend (#1727)
|
2024-10-20 02:38:35 -07:00 |
|