 Yineng Zhang
|
7e257cd666
|
chore: bump v0.4.6.post5 (#6566)
|
2025-05-24 00:48:05 -07:00 |
|
|
Yineng Zhang
|
a6970a17f3
|
misc: fix accept_length (#6536)
|
2025-05-22 14:27:10 -07:00 |
|
|
Yineng Zhang
|
0b07c4a99f
|
chore: upgrade sgl-kernel v0.1.4 (#6532)
|
2025-05-22 13:28:16 -07:00 |
|
|
Yineng Zhang
|
d71f3f0a2a
|
chore: bump sgl-kernel v0.1.4 (#6522)
|
2025-05-22 09:47:42 -07:00 |
|
|
Yineng Zhang
|
b146555749
|
Revert "Implement return_hidden_states for the OpenAI API (#6137)" (#6440)
|
2025-05-19 18:21:29 -07:00 |
|
|
Yineng Zhang
|
eabcf82acb
|
feat: add long context example (#6391)
|
2025-05-18 01:45:17 -07:00 |
|
|
Yineng Zhang
|
f07c6a009b
|
chore: upgrade sgl-kernel v0.1.3 (#6377)
|
2025-05-17 19:47:05 -07:00 |
|
|
Yineng Zhang
|
3d7f7a43c8
|
chore: bump sgl-kernel v0.1.3 (#6368)
|
2025-05-17 00:15:55 -07:00 |
|
|
Yineng Zhang
|
69748d088d
|
docs: update readme (#6361)
|
2025-05-16 16:16:23 -07:00 |
|
|
Yineng Zhang
|
16267d4fa7
|
chore: bump v0.4.6.post4 (#6245)
|
2025-05-13 01:57:51 -07:00 |
|
|
Yineng Zhang
|
f24fc5b86d
|
fix typo (#6248)
|
2025-05-12 15:45:12 -07:00 |
|
|
Yineng Zhang
|
f94543d22b
|
chore: add hf_xet dep (#6243)
|
2025-05-12 13:08:40 -07:00 |
|
|
Yineng Zhangandalcanderian
|
230106304d
|
chore: upgrade sgl-kernel v0.1.2.post1 (#6196)
Co-authored-by: alcanderian <alcanderian@gmail.com>
|
2025-05-11 22:41:37 +08:00 |
|
|
Yineng Zhang
|
45b4dcf037
|
chore: bump sgl-kernel v0.1.2.post1 (#6195)
|
2025-05-11 02:24:10 -07:00 |
|
|
Yineng Zhang
|
213e8c7dd5
|
chore: upgrade deepgemm (#6073)
|
2025-05-11 02:17:24 -07:00 |
|
|
Yineng Zhang
|
4d1c9db66c
|
feat: support loogle eval (#6190)
|
2025-05-10 23:52:44 -07:00 |
|
|
Yineng Zhang
|
66fc63d6b1
|
Revert "feat: add thinking_budget (#6089)" (#6181)
|
2025-05-10 16:07:45 -07:00 |
|
|
Yineng Zhang
|
678d8cc987
|
chore: bump v0.4.6.post3 (#6165)
|
2025-05-09 15:38:47 -07:00 |
|
|
Yineng Zhang
|
8dc4efd0ab
|
docs: update README (#6132)
|
2025-05-08 15:18:48 -07:00 |
|
|
Yineng Zhang
|
6578cf27de
|
chore: bump sgl-kernel 0.1.2 (#6131)
|
2025-05-08 15:16:28 -07:00 |
|
|
Yineng Zhangandyizhang2077
|
6f56614734
|
chore: upgrade cutlass 3.9.2 (#6004)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-05-06 13:34:08 -07:00 |
|
|
Yineng Zhang
|
5f300141b7
|
docs: add new blog (#6048)
|
2025-05-06 00:48:10 -07:00 |
|
|
Yineng Zhang
|
1c05425bcb
|
docs: add Google Cloud Vertex AI in Adoption and Sponsorship (#6047)
|
2025-05-06 00:31:48 -07:00 |
|
|
Yineng Zhang
|
141a459644
|
fix: only upgrade nccl for cu128 (#5986)
|
2025-05-02 11:31:29 -07:00 |
|
|
Yineng Zhang
|
9858113c33
|
chore: bump v0.4.6.post2 (#5939)
|
2025-04-30 22:04:40 -07:00 |
|
|
Yineng Zhang
|
8441baad6e
|
fix: update model runner (#5934)
|
2025-04-30 19:49:26 -07:00 |
|
|
Yineng Zhang
|
9a6ad8916d
|
chore: upgrade sgl-kernel 0.1.1 (#5933)
|
2025-04-30 16:13:30 -07:00 |
|
|
Yineng Zhang
|
d353d08b4e
|
chore: bump sgl-kernel 0.1.1 (#5932)
|
2025-04-30 14:01:49 -07:00 |
|
|
Yineng Zhang
|
a043f7f2ab
|
chore: use torch 2.6 for sgl-kernel build (#5898)
|
2025-04-29 17:51:18 -07:00 |
|
|
Yineng Zhang
|
9a62191ba7
|
chore: update CODEOWNERS (#5895)
|
2025-04-29 14:12:04 -07:00 |
|
|
Yineng Zhang
|
f4c191a712
|
chore: update Dockerfile (#5894)
|
2025-04-29 12:55:13 -07:00 |
|
|
Yineng Zhang
|
dcae1fb2cd
|
chore: bump v0.4.6.post1 (#5845)
|
2025-04-28 12:57:08 -07:00 |
|
|
Yineng Zhang
|
663037a7a0
|
feat: update is_fa3_default_architecture (#5854)
|
2025-04-28 11:53:22 -07:00 |
|
|
Yineng Zhang
|
41ac0c6d48
|
chore: upgrade sgl-kernel 0.1.0 (#5690)
|
2025-04-27 21:00:50 -07:00 |
|
|
Yineng Zhang
|
7d0edf3cae
|
chore: bump sgl-kernel 0.1.0 (#5688)
|
2025-04-23 14:23:59 -07:00 |
|
|
Yineng Zhang
|
ce4ecba477
|
fix: only compile ApplyTokenBitmaskInplace cu124+ (#5686)
|
2025-04-23 14:17:42 -07:00 |
|
|
Yineng Zhang
|
b1f6d89b5f
|
fix: update truss bench_serving (#5683)
|
2025-04-23 13:28:35 -07:00 |
|
|
Yineng Zhang
|
127ff8982e
|
fix torchvision::nms not exist (#5671)
|
2025-04-23 02:17:21 -07:00 |
|
|
Yineng Zhang
|
8777a1d24b
|
fix gemma3 unit test (#5670)
|
2025-04-23 02:14:01 -07:00 |
|
|
Yineng Zhang
|
fbb5f229d4
|
fix awq_dequantize import (#5669)
|
2025-04-23 01:36:26 -07:00 |
|
|
Yineng Zhang
|
15fabcc07f
|
fix sgl-kernel unit tests (#5666)
|
2025-04-23 01:18:30 -07:00 |
|
|
Yineng Zhang
|
7282ab741a
|
fix: update bench_speculative (#5649)
|
2025-04-22 16:08:15 -07:00 |
|
|
Yineng Zhang
|
04f2abcb34
|
fix: gemma 3 not use softcap (#5622)
|
2025-04-22 01:16:08 -07:00 |
|
|
Yineng Zhang
|
b9c87e781d
|
chore: bump v0.4.5.post3 (#5611)
|
2025-04-21 18:16:20 -07:00 |
|
|
Yineng Zhang
|
66c0ff9e31
|
fix: use fa3 for gemma2 (#5586)
|
2025-04-20 17:02:09 -07:00 |
|
|
Yineng Zhang
|
0961feefca
|
feat: use flashinfer jit package (#5547)
|
2025-04-19 00:28:39 -07:00 |
|
|
Yineng Zhang
|
2c11f9c2eb
|
chore: upgrade sgl-kernel 0.0.9.post2 (#5540)
|
2025-04-18 21:17:23 -07:00 |
|
|
Yineng Zhang
|
a6f892e5d0
|
Revert "Avoid computing lse in Ragged Prefill when there's no prefix.… (#5544)
|
2025-04-18 16:50:21 -07:00 |
|
|
Yineng Zhang
|
08b518d51f
|
fix util import (#5542)
|
2025-04-18 15:06:46 -07:00 |
|
|
Yineng Zhang
|
f28d82997a
|
chore: bump sgl-kernel 0.0.9.post2 (#5518)
|
2025-04-17 23:42:39 -07:00 |
|
|
Yineng Zhang
|
5b5c7237c8
|
chore: bump v0.4.5.post1 (#5445)
|
2025-04-15 23:00:07 -07:00 |
|
|
Yineng Zhang
|
8ec0bb7d55
|
chore: upgrade sgl-kernel 0.0.9.post1 (#5436)
|
2025-04-15 15:45:51 -07:00 |
|
|
Yineng Zhangandhebiao064
|
fa909dc3c4
|
feat: update model_specific_adjustment (#5344)
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
|
2025-04-15 14:45:15 -07:00 |
|
|
Yineng Zhang
|
88defc4d89
|
fix: solve release issue (#5434)
|
2025-04-15 12:58:11 -07:00 |
|
|
Yineng Zhang
|
6f509d5503
|
chore: bump sgl-kernel v0.0.9.post1 (#5430)
|
2025-04-15 11:00:21 -07:00 |
|
|
Yineng Zhang
|
8aab7fdb21
|
chore: upgrade sgl-kernel 0.0.9 (#5401)
|
2025-04-14 22:37:59 -07:00 |
|
|
Yineng Zhang
|
e940dc4f06
|
chore: bump sgl-kernel 0.0.9 (#5400)
|
2025-04-14 21:34:04 -07:00 |
|
|
Yineng Zhang
|
11421a3f44
|
fix: update pr-test-sgl-kernel (#5399)
|
2025-04-14 21:14:59 -07:00 |
|
|
Yineng Zhang
|
6c41fcf0e4
|
chore: upgrade DeepGEMM (#5395)
|
2025-04-14 20:32:46 -07:00 |
|
|
Yineng Zhang
|
ac5b78baf6
|
fix: update test config (#5392)
|
2025-04-14 17:39:47 -07:00 |
|
|
Yineng Zhang
|
39d90449f3
|
feat: update experiment_runner (#5360)
|
2025-04-13 15:37:05 -07:00 |
|
|
Yineng Zhang
|
39e411385c
|
fix #5322 (#5359)
|
2025-04-13 13:57:36 -07:00 |
|
|
Yineng Zhang
|
f58b929a51
|
chore: upgrade sgl-kernel 0.0.8.post3 (#5342)
|
2025-04-13 00:45:59 -07:00 |
|
|
Yineng Zhang
|
c1270aabc5
|
docs: update adoption and sponsorship list with Oracle (#5343)
|
2025-04-12 22:55:25 -07:00 |
|
|
Yineng Zhang
|
c138025731
|
misc: update sagemaker Dockerfile (#5341)
|
2025-04-12 22:39:49 -07:00 |
|
|
Yineng Zhang
|
b62e7e99b8
|
feat: adapt merge_state (#5337)
|
2025-04-12 21:14:04 -07:00 |
|
|
Yineng Zhang
|
7d3b7c87f5
|
fix: determine if flashinfer is installed (#5336)
|
2025-04-12 19:59:13 -07:00 |
|
|
Yineng Zhang
|
75015bb688
|
ci: update release node (#5333)
|
2025-04-12 14:22:45 -07:00 |
|
|
Yineng Zhang
|
b371f7cd36
|
chore: bump sgl-kernel v0.0.8.post3 (#5332)
|
2025-04-12 12:53:37 -07:00 |
|
|
Yineng Zhang
|
812e82f35e
|
fix: solve cu118 issue for cutlass mla (#5331)
|
2025-04-12 12:51:09 -07:00 |
|
|
|
57de7c6b5f
|
feat: use fa3 mla by default on hopper (#5210)
Co-authored-by: yundai424 <yundai424@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
|
2025-04-12 01:09:25 -07:00 |
|
|
Yineng Zhang
|
115ae2e728
|
chore: bump sgl-kernel v0.0.8.post2 (#5317)
|
2025-04-11 23:42:03 -07:00 |
|
|
Yineng Zhang
|
2eb55770f9
|
misc: cleanup 3rdparty (#5311)
|
2025-04-11 22:53:50 -07:00 |
|
|
Yineng Zhang
|
611720919d
|
fix: use deepgemm only on hopper (#5310)
|
2025-04-11 20:48:24 -07:00 |
|
|
Yineng Zhang
|
4f288113ce
|
fix: update flash attn (#5308)
|
2025-04-11 16:23:09 -07:00 |
|
|
Yineng Zhang
|
136b8e6afb
|
fix: remove cublas_grouped_gemm (#5307)
|
2025-04-11 16:22:37 -07:00 |
|
|
Yineng Zhang
|
034c5256cc
|
misc: update blackwell Dockerfile (#5306)
|
2025-04-11 15:58:04 -07:00 |
|
|
Yineng Zhang
|
c1dd773c19
|
fix: use fa3 unit test on hopper only (#5304)
|
2025-04-11 15:10:49 -07:00 |
|
|
Yineng Zhang
|
6f8593799b
|
feat: add blackwell workflow (#5303)
|
2025-04-11 13:42:00 -07:00 |
|
|
Yineng Zhang
|
f774a0d275
|
feat: add blackwell Dockerfile (#5302)
|
2025-04-11 13:08:53 -07:00 |
|
|
Yineng Zhang
|
80aa8ca84e
|
fix: update update_wheel_index for cu128 (#5300)
|
2025-04-11 09:31:03 -07:00 |
|
|
Yineng Zhang
|
c163bf4ff1
|
chore: bump sgl-kernel v0.0.8.post1 (#5289)
|
2025-04-11 02:11:53 -07:00 |
|
|
Yineng Zhang
|
5598634326
|
chore: relax the torch version restriction for sgl-kernel compilation (#5288)
|
2025-04-11 02:05:53 -07:00 |
|
|
Yineng Zhang
|
b75275b6f2
|
feat: add cu128 identifier for sgl-kernel (#5287)
|
2025-04-11 01:58:46 -07:00 |
|
|
Yineng Zhang
|
7074e9ca20
|
fix: enable fp4 compilation on cu128 (#5286)
|
2025-04-11 01:43:44 -07:00 |
|
|
Yineng Zhang
|
4cb53ecd0c
|
fix: log warning when disable cuda graph (#5209)
|
2025-04-09 14:16:13 -07:00 |
|
|
Yineng Zhang
|
90caf06c00
|
fix: use DeepEPDispatcher on CUDA (#5180)
|
2025-04-08 21:56:53 -07:00 |
|
|
Yineng Zhangandgrimoire
|
6669d12707
|
feat: add DeepGEMM build warning (#5176)
Co-authored-by: grimoire <streetyao@live.com>
|
2025-04-08 21:16:23 -07:00 |
|
|
Yineng Zhang
|
57f99608f4
|
bump v0.4.5 (#5117)
|
2025-04-07 00:35:00 -07:00 |
|
|
Yineng Zhang
|
35e0856b90
|
bump v0.4.4.post4 (#5091)
|
2025-04-05 15:36:17 -07:00 |
|
|
Yineng Zhang
|
496dde8491
|
bump sgl-kernel 0.0.8 (#5089)
|
2025-04-05 14:28:04 -07:00 |
|
|
Yineng Zhang
|
0d99adb715
|
upgrade transformers 4.51.0 (#5088)
|
2025-04-05 14:20:23 -07:00 |
|
|
Yineng Zhang
|
3f287b8579
|
support sgl-kernel on blackwell (#5074)
|
2025-04-04 16:59:32 -07:00 |
|
|
Yineng Zhang
|
e53bf190bc
|
upgrade sgl-kernel v0.0.7 (#5049)
|
2025-04-03 17:07:54 -07:00 |
|
|
Yineng Zhang
|
3289c1207d
|
Update the retry count (#5051)
|
2025-04-03 17:07:38 -07:00 |
|
|
Yineng Zhang
|
d7954b7682
|
bump sgl-kernel v0.0.7 (#5046)
|
2025-04-03 13:38:13 -07:00 |
|
|
Yineng Zhang
|
fda6bb78da
|
update bench_serving (#4958)
|
2025-04-01 15:10:56 -07:00 |
|
|
Yineng Zhang
|
1c63e79756
|
use fa3 in sgl-kernel (#4954)
|
2025-03-31 16:14:49 -07:00 |
|
|
Yineng Zhang
|
6384d31776
|
bump sgl-kernel v0.0.6 (#4950)
|
2025-03-31 11:24:09 -07:00 |
|
|
Yineng Zhang
|
4814ecaff9
|
cleanup sgl-kernel (#4933)
|
2025-03-30 14:12:30 -07:00 |
|