 Yineng Zhang
|
66c0ff9e31
|
fix: use fa3 for gemma2 (#5586)
|
2025-04-20 17:02:09 -07:00 |
|
|
Yineng Zhang
|
0961feefca
|
feat: use flashinfer jit package (#5547)
|
2025-04-19 00:28:39 -07:00 |
|
|
Yineng Zhang
|
2c11f9c2eb
|
chore: upgrade sgl-kernel 0.0.9.post2 (#5540)
|
2025-04-18 21:17:23 -07:00 |
|
|
Yineng Zhang
|
a6f892e5d0
|
Revert "Avoid computing lse in Ragged Prefill when there's no prefix.… (#5544)
|
2025-04-18 16:50:21 -07:00 |
|
|
Yineng Zhang
|
08b518d51f
|
fix util import (#5542)
|
2025-04-18 15:06:46 -07:00 |
|
|
Yineng Zhang
|
f28d82997a
|
chore: bump sgl-kernel 0.0.9.post2 (#5518)
|
2025-04-17 23:42:39 -07:00 |
|
|
Yineng Zhang
|
5b5c7237c8
|
chore: bump v0.4.5.post1 (#5445)
|
2025-04-15 23:00:07 -07:00 |
|
|
Yineng Zhang
|
8ec0bb7d55
|
chore: upgrade sgl-kernel 0.0.9.post1 (#5436)
|
2025-04-15 15:45:51 -07:00 |
|
|
Yineng Zhangandhebiao064
|
fa909dc3c4
|
feat: update model_specific_adjustment (#5344)
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
|
2025-04-15 14:45:15 -07:00 |
|
|
Yineng Zhang
|
88defc4d89
|
fix: solve release issue (#5434)
|
2025-04-15 12:58:11 -07:00 |
|
|
Yineng Zhang
|
6f509d5503
|
chore: bump sgl-kernel v0.0.9.post1 (#5430)
|
2025-04-15 11:00:21 -07:00 |
|
|
Yineng Zhang
|
8aab7fdb21
|
chore: upgrade sgl-kernel 0.0.9 (#5401)
|
2025-04-14 22:37:59 -07:00 |
|
|
Yineng Zhang
|
e940dc4f06
|
chore: bump sgl-kernel 0.0.9 (#5400)
|
2025-04-14 21:34:04 -07:00 |
|
|
Yineng Zhang
|
11421a3f44
|
fix: update pr-test-sgl-kernel (#5399)
|
2025-04-14 21:14:59 -07:00 |
|
|
Yineng Zhang
|
6c41fcf0e4
|
chore: upgrade DeepGEMM (#5395)
|
2025-04-14 20:32:46 -07:00 |
|
|
Yineng Zhang
|
ac5b78baf6
|
fix: update test config (#5392)
|
2025-04-14 17:39:47 -07:00 |
|
|
Yineng Zhang
|
39d90449f3
|
feat: update experiment_runner (#5360)
|
2025-04-13 15:37:05 -07:00 |
|
|
Yineng Zhang
|
39e411385c
|
fix #5322 (#5359)
|
2025-04-13 13:57:36 -07:00 |
|
|
Yineng Zhang
|
f58b929a51
|
chore: upgrade sgl-kernel 0.0.8.post3 (#5342)
|
2025-04-13 00:45:59 -07:00 |
|
|
Yineng Zhang
|
c1270aabc5
|
docs: update adoption and sponsorship list with Oracle (#5343)
|
2025-04-12 22:55:25 -07:00 |
|
|
Yineng Zhang
|
c138025731
|
misc: update sagemaker Dockerfile (#5341)
|
2025-04-12 22:39:49 -07:00 |
|
|
Yineng Zhang
|
b62e7e99b8
|
feat: adapt merge_state (#5337)
|
2025-04-12 21:14:04 -07:00 |
|
|
Yineng Zhang
|
7d3b7c87f5
|
fix: determine if flashinfer is installed (#5336)
|
2025-04-12 19:59:13 -07:00 |
|
|
Yineng Zhang
|
75015bb688
|
ci: update release node (#5333)
|
2025-04-12 14:22:45 -07:00 |
|
|
Yineng Zhang
|
b371f7cd36
|
chore: bump sgl-kernel v0.0.8.post3 (#5332)
|
2025-04-12 12:53:37 -07:00 |
|
|
Yineng Zhang
|
812e82f35e
|
fix: solve cu118 issue for cutlass mla (#5331)
|
2025-04-12 12:51:09 -07:00 |
|
|
|
57de7c6b5f
|
feat: use fa3 mla by default on hopper (#5210)
Co-authored-by: yundai424 <yundai424@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
|
2025-04-12 01:09:25 -07:00 |
|
|
Yineng Zhang
|
115ae2e728
|
chore: bump sgl-kernel v0.0.8.post2 (#5317)
|
2025-04-11 23:42:03 -07:00 |
|
|
Yineng Zhang
|
2eb55770f9
|
misc: cleanup 3rdparty (#5311)
|
2025-04-11 22:53:50 -07:00 |
|
|
Yineng Zhang
|
611720919d
|
fix: use deepgemm only on hopper (#5310)
|
2025-04-11 20:48:24 -07:00 |
|
|
Yineng Zhang
|
4f288113ce
|
fix: update flash attn (#5308)
|
2025-04-11 16:23:09 -07:00 |
|
|
Yineng Zhang
|
136b8e6afb
|
fix: remove cublas_grouped_gemm (#5307)
|
2025-04-11 16:22:37 -07:00 |
|
|
Yineng Zhang
|
034c5256cc
|
misc: update blackwell Dockerfile (#5306)
|
2025-04-11 15:58:04 -07:00 |
|
|
Yineng Zhang
|
c1dd773c19
|
fix: use fa3 unit test on hopper only (#5304)
|
2025-04-11 15:10:49 -07:00 |
|
|
Yineng Zhang
|
6f8593799b
|
feat: add blackwell workflow (#5303)
|
2025-04-11 13:42:00 -07:00 |
|
|
Yineng Zhang
|
f774a0d275
|
feat: add blackwell Dockerfile (#5302)
|
2025-04-11 13:08:53 -07:00 |
|
|
Yineng Zhang
|
80aa8ca84e
|
fix: update update_wheel_index for cu128 (#5300)
|
2025-04-11 09:31:03 -07:00 |
|
|
Yineng Zhang
|
c163bf4ff1
|
chore: bump sgl-kernel v0.0.8.post1 (#5289)
|
2025-04-11 02:11:53 -07:00 |
|
|
Yineng Zhang
|
5598634326
|
chore: relax the torch version restriction for sgl-kernel compilation (#5288)
|
2025-04-11 02:05:53 -07:00 |
|
|
Yineng Zhang
|
b75275b6f2
|
feat: add cu128 identifier for sgl-kernel (#5287)
|
2025-04-11 01:58:46 -07:00 |
|
|
Yineng Zhang
|
7074e9ca20
|
fix: enable fp4 compilation on cu128 (#5286)
|
2025-04-11 01:43:44 -07:00 |
|
|
Yineng Zhang
|
4cb53ecd0c
|
fix: log warning when disable cuda graph (#5209)
|
2025-04-09 14:16:13 -07:00 |
|
|
Yineng Zhang
|
90caf06c00
|
fix: use DeepEPDispatcher on CUDA (#5180)
|
2025-04-08 21:56:53 -07:00 |
|
|
Yineng Zhangandgrimoire
|
6669d12707
|
feat: add DeepGEMM build warning (#5176)
Co-authored-by: grimoire <streetyao@live.com>
|
2025-04-08 21:16:23 -07:00 |
|
|
Yineng Zhang
|
57f99608f4
|
bump v0.4.5 (#5117)
|
2025-04-07 00:35:00 -07:00 |
|
|
Yineng Zhang
|
35e0856b90
|
bump v0.4.4.post4 (#5091)
|
2025-04-05 15:36:17 -07:00 |
|
|
Yineng Zhang
|
496dde8491
|
bump sgl-kernel 0.0.8 (#5089)
|
2025-04-05 14:28:04 -07:00 |
|
|
Yineng Zhang
|
0d99adb715
|
upgrade transformers 4.51.0 (#5088)
|
2025-04-05 14:20:23 -07:00 |
|
|
Yineng Zhang
|
3f287b8579
|
support sgl-kernel on blackwell (#5074)
|
2025-04-04 16:59:32 -07:00 |
|
|
Yineng Zhang
|
e53bf190bc
|
upgrade sgl-kernel v0.0.7 (#5049)
|
2025-04-03 17:07:54 -07:00 |
|
|
Yineng Zhang
|
3289c1207d
|
Update the retry count (#5051)
|
2025-04-03 17:07:38 -07:00 |
|
|
Yineng Zhang
|
d7954b7682
|
bump sgl-kernel v0.0.7 (#5046)
|
2025-04-03 13:38:13 -07:00 |
|
|
Yineng Zhang
|
fda6bb78da
|
update bench_serving (#4958)
|
2025-04-01 15:10:56 -07:00 |
|
|
Yineng Zhang
|
1c63e79756
|
use fa3 in sgl-kernel (#4954)
|
2025-03-31 16:14:49 -07:00 |
|
|
Yineng Zhang
|
6384d31776
|
bump sgl-kernel v0.0.6 (#4950)
|
2025-03-31 11:24:09 -07:00 |
|
|
Yineng Zhang
|
4814ecaff9
|
cleanup sgl-kernel (#4933)
|
2025-03-30 14:12:30 -07:00 |
|
|
Yineng Zhang
|
195a09f57c
|
fix bmm fp8 (#4926)
|
2025-03-30 12:15:20 -07:00 |
|
|
Yineng Zhang
|
54b9a2de0a
|
remove setup for sgl-kernel (#4899)
|
2025-03-29 12:47:38 -07:00 |
|
|
Yineng Zhang
|
400ad66019
|
Update CODEOWNERS (#4889)
|
2025-03-29 09:56:51 -07:00 |
|
|
Yineng Zhang
|
19e96e5923
|
bump v0.4.4.post3 (#4878)
|
2025-03-28 23:21:24 -07:00 |
|
|
Yineng Zhang
|
d8a136a113
|
upgrade sgl-kernel 0.0.5.post4 (#4873)
|
2025-03-28 19:48:56 -07:00 |
|
|
Yineng Zhang
|
ec3ee0289d
|
fix sgl-kernel cu118 build (#4872)
|
2025-03-28 17:23:51 -07:00 |
|
|
Yineng Zhang
|
92941ce7b5
|
bump sgl-kernel 0.0.5.post4 (#4768)
|
2025-03-28 14:40:53 -07:00 |
|
|
Yineng Zhang
|
2bb0e7cf43
|
fix sampling issue (#4871)
|
2025-03-28 14:07:21 -07:00 |
|
|
Yineng Zhang
|
72549263c6
|
update sgl-kernel test ci (#4866)
|
2025-03-28 11:42:41 -07:00 |
|
|
Yineng Zhang
|
6dea5c96bf
|
Revert "get the python version from env (#4729)" (#4863)
|
2025-03-28 08:07:48 -07:00 |
|
|
Yineng Zhang
|
31dfff7da7
|
use default for torch.ops (#4835)
|
2025-03-27 19:09:58 -07:00 |
|
|
Yineng Zhang
|
5fa3058f01
|
fix the release doc dependency issue (#4828)
|
2025-03-27 13:28:12 -07:00 |
|
|
Yineng Zhang
|
bbab97a6a8
|
add partial_json_parser and einops (#4827)
|
2025-03-27 13:24:54 -07:00 |
|
|
|
8bf6d7f406
|
support cmake for sgl-kernel (#4706)
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>
|
2025-03-27 01:42:28 -07:00 |
|
|
Yineng Zhang
|
6f5cc5eb05
|
update xgrammar 0.1.17 (#4804)
|
2025-03-27 00:21:59 -07:00 |
|
|
Yineng Zhang
|
1099f6c974
|
bump v0.4.4.post2 (#4669)
|
2025-03-26 19:58:00 -07:00 |
|
|
Yineng Zhang
|
9b7cf9ee6c
|
support cu128 sgl-kernel (#4744)
|
2025-03-24 20:53:23 -07:00 |
|
|
Yineng Zhang
|
c11cfda07b
|
update pyproject (#4731)
|
2025-03-24 09:50:28 -07:00 |
|
|
Yineng Zhang
|
e7a8610d51
|
fix flaky ut (#4670)
|
2025-03-22 12:36:50 -07:00 |
|
|
Yineng Zhang
|
f69e0696bc
|
update news for README (#4664)
|
2025-03-21 23:25:59 -07:00 |
|
|
Yineng Zhang
|
c787298547
|
use sgl custom all reduce (#4441)
|
2025-03-18 00:46:41 -07:00 |
|
|
Yineng Zhang
|
c16b33ccac
|
cleanup deps 3/n (#4541)
|
2025-03-18 00:11:36 -07:00 |
|
|
Yineng Zhang
|
f81a27f65e
|
upgrade sgl-kernel 0.0.5.post3 (#4522)
|
2025-03-17 14:49:56 -07:00 |
|
|
Yineng Zhang
|
988ab646ec
|
bump v0.0.5.post3 (#4520)
|
2025-03-17 13:05:59 -07:00 |
|
|
Yineng Zhang
|
9971dc2283
|
Revert "feat: Add FlashMLA submodule (#4449)" (#4470)
|
2025-03-16 01:30:05 -07:00 |
|
|
Yineng Zhang
|
65b7c9b78f
|
cleanup deps 2/n (#4464)
|
2025-03-15 23:06:17 -07:00 |
|
|
Yineng Zhang
|
ad1ae7f7cd
|
use topk_softmax with sgl-kernel (#4439)
|
2025-03-14 15:59:06 -07:00 |
|
|
Yineng Zhang
|
862fe52241
|
bump v0.0.5.post1 (#4437)
|
2025-03-14 15:00:26 -07:00 |
|
|
Yineng Zhangandsleepcoo
|
977d7cd26a
|
cleanup deps 1/n (#4400)
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
|
2025-03-14 00:00:33 -07:00 |
|
|
Yineng Zhang
|
ba80c102f9
|
bump v0.4.4.post1 (#4402)
|
2025-03-13 17:53:46 -07:00 |
|
|
Yineng Zhang
|
6aaeb84872
|
chore: bump v0.4.4 (#4041)
|
2025-03-13 02:49:58 -07:00 |
|
|
Yineng Zhang
|
3623b6a7f5
|
upgrade sgl-kernel 0.0.5 (#4381)
|
2025-03-13 02:37:56 -07:00 |
|
|
Yineng Zhang
|
4ff1264201
|
Update pyproject.toml
|
2025-03-13 02:16:51 -07:00 |
|
|
Yineng Zhang
|
2a4cbad8e9
|
bump 0.0.5 sgl-kernel (#4377)
|
2025-03-13 02:08:35 -07:00 |
|
|
Yineng Zhang
|
2937387a50
|
fix accuracy issue (#4376)
|
2025-03-13 02:06:22 -07:00 |
|
|
Yineng Zhang
|
ed91561f79
|
upgrade sgl-kernel 0.0.4.post3 (#4334)
|
2025-03-12 01:36:41 -07:00 |
|
|
Yineng Zhang
|
6e7239f912
|
release 0.0.4.post3 sgl-kernel (#4331)
|
2025-03-12 01:05:16 -07:00 |
|
|
Yineng Zhang
|
0a3960f21f
|
fix awq_dequantize (#4333)
|
2025-03-12 01:04:38 -07:00 |
|
|
Yineng Zhang
|
d1da58e275
|
unify is_cuda and is_hip (#4321)
|
2025-03-11 18:12:56 -07:00 |
|
|
Yineng Zhangandqingquansong
|
1cf63485c1
|
upgrade flashinfer 0.2.3 (#4317)
Co-authored-by: qingquansong <qsong@linkedin.com>
|
2025-03-11 15:37:17 -07:00 |
|
|
Yineng Zhang
|
00f42707ea
|
update doc (#4299)
|
2025-03-11 01:14:16 -07:00 |
|
|
Yineng Zhang
|
4d27eb9ad1
|
update sgl-kernel 0.0.4.post2 (#4291)
|
2025-03-11 00:34:33 -07:00 |
|
|
Yineng Zhang
|
cd90945518
|
bump sgl-kernel 0.0.4.post2 (#4288)
|
2025-03-11 00:09:47 -07:00 |
|
|
Yineng Zhang
|
bde24ab31f
|
update deepgemm (#4284)
|
2025-03-10 23:39:57 -07:00 |
|