 Yineng Zhang
|
b1a540ec42
|
feat: update GemmaRMSNorm (#1232)
|
2024-08-28 22:47:34 +10:00 |
|
|
Yineng Zhang
|
66975360e7
|
fix: increase max_new_tokens when testing generation models (#1244)
|
2024-08-28 22:12:36 +10:00 |
|
|
Yineng Zhang
|
f25f4dfde5
|
hotfix: revert sampler CUDA Graph (#1242)
|
2024-08-28 21:16:47 +10:00 |
|
|
Yineng Zhang
|
198974cd1a
|
feat: support sm75 with FlashInfer v0.1.6 (#1233)
|
2024-08-28 18:39:12 +10:00 |
|
|
Yineng Zhang
|
3602692c7c
|
feat: replace get_act_fn for gpt_bigcode (#1231)
|
2024-08-27 21:15:31 +10:00 |
|
|
Yineng Zhang
|
c5fe11a8e1
|
chore: bump v0.2.14 (#1155)
|
2024-08-27 00:28:24 +10:00 |
|
|
Yineng Zhang
|
c9064e6fd9
|
feat: use gelu_tanh_and_mul (#1193)
|
2024-08-24 01:58:16 -07:00 |
|
|
Yineng Zhang
|
1fb9459908
|
fix: custom op fallback forward native when lower sm80 (#1177)
|
2024-08-21 14:26:35 -07:00 |
|
|
Yineng Zhang
|
350a81609b
|
fix: resolve README render (#1166)
|
2024-08-21 03:23:52 +10:00 |
|
|
Yineng Zhang
|
04707b09b7
|
misc: add hypervisor vendor (#1165)
|
2024-08-21 02:14:51 +10:00 |
|
|
Yineng Zhang
|
9208591f05
|
fix: use fp16 dtype for sm75 (#1136)
|
2024-08-18 00:45:42 +10:00 |
|
|
Yineng Zhang
|
6aa8ad14f8
|
fix: resolve Python.h header missing (#1119)
|
2024-08-16 15:46:43 +10:00 |
|
|
Yineng Zhang
|
26e9c12c15
|
ci: compatible with fork repo (#1115)
|
2024-08-16 04:26:44 +10:00 |
|
|
Yineng Zhang
|
5bd953749b
|
chore: bump v0.2.13 (#1111)
|
2024-08-16 03:50:43 +10:00 |
|
|
Yineng Zhang
|
9195d1362a
|
misc: rm unused model_loader (#1110)
|
2024-08-15 08:29:35 -07:00 |
|
|
Yineng Zhang
|
1c2b5f5240
|
docs: update nsys usage (#1103)
|
2024-08-15 01:39:15 +08:00 |
|
|
Yineng Zhang
|
67c0d832a6
|
docs: update pr template (#1099)
|
2024-08-14 22:25:39 +10:00 |
|
|
Yineng Zhang
|
fe5024325b
|
docs: update README (#1098)
|
2024-08-14 04:40:05 -07:00 |
|
|
Yineng Zhang
|
f14569f64a
|
ci: remove workflow path trigger (#1096)
|
2024-08-14 20:36:24 +10:00 |
|
|
Yineng ZhangandLiangsheng Yin
|
c8423ca311
|
ci: update timeout and retry (#1086)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2024-08-14 00:27:35 -07:00 |
|
|
Yineng Zhang
|
cebd78d83e
|
ci: add accuracy timeout (#1078)
|
2024-08-13 22:12:58 +10:00 |
|
|
Yineng Zhang
|
0076f11541
|
fix: use devel for Triton's compiler requirements (#1074)
|
2024-08-13 04:08:43 -07:00 |
|
|
Yineng Zhang
|
f7fb68d292
|
ci: add moe test (#1053)
|
2024-08-13 18:43:23 +10:00 |
|
|
Yineng Zhang
|
396a13e6ad
|
ci: add cancel pr workflow (#1070)
|
2024-08-13 18:16:50 +10:00 |
|
|
Yineng Zhangandispobock
|
65915f9f3e
|
fix: temporary solution for DeepSeek V2 H100 layout conversion issue (#1060)
Co-authored-by: ispobock <ISPObaoke@163.com>
|
2024-08-13 15:48:54 +10:00 |
|
|
Yineng Zhang
|
65e89baea9
|
fix: not use the default port (#1068)
|
2024-08-13 15:12:56 +10:00 |
|
|
Yineng Zhang
|
6a38efa834
|
feat: replace all rmsnorm and silu (#1057)
|
2024-08-13 02:15:59 +10:00 |
|
|
Yineng Zhang
|
b0ad0c1bc8
|
chore: bump v0.2.12 (#1048)
|
2024-08-12 20:59:38 +10:00 |
|
|
Yineng Zhang
|
89f23a5178
|
docs: update setup github runner (#1050)
|
2024-08-12 18:11:38 +10:00 |
|
|
Yineng Zhangandvhain
|
cb99ba4fc6
|
feat: update Dockerfile (#1033)
Co-authored-by: vhain <vhain6512@gmail.com>
|
2024-08-12 16:24:06 +10:00 |
|
|
Yineng Zhang
|
c245b78973
|
hotfix: add CustomOp abstraction (#1027)
|
2024-08-11 02:45:59 -07:00 |
|
|
Yineng Zhang
|
33d61356b8
|
misc: update issue template (#1024)
|
2024-08-11 17:34:30 +10:00 |
|
|
Yineng Zhang
|
94752ac811
|
feat: use FlashInfer rmsnorm and silu (#907)
|
2024-08-11 14:57:13 +10:00 |
|
|
Yineng Zhang
|
e712837d38
|
misc: update test config (#990)
|
2024-08-11 04:20:30 +10:00 |
|
|
Yineng Zhang
|
b568df5d03
|
fix: resolve correctness_test issue (#1002)
|
2024-08-09 23:21:42 +10:00 |
|
|
Yineng Zhang
|
dc9d06d886
|
chore: bump v0.2.11 (#970)
|
2024-08-07 20:47:53 +08:00 |
|
|
Yineng Zhang
|
c31f084c71
|
chore: update vllm to 0.5.4 (#966)
|
2024-08-07 21:15:41 +10:00 |
|
|
Yineng Zhang
|
05abd1261c
|
misc: add compute capability in check_env (#965)
|
2024-08-07 18:39:36 +10:00 |
|
|
Yineng Zhang
|
58a0970853
|
misc: update issue template (#963)
|
2024-08-07 17:41:21 +10:00 |
|
|
Yineng Zhang
|
fde8340550
|
docs: update README (#935)
|
2024-08-05 20:06:06 +10:00 |
|
|
Yineng Zhang
|
f4d9953d9d
|
misc: add triton in check_env PACKAGE_LIST (#914)
|
2024-08-04 23:20:59 +10:00 |
|
|
Yineng Zhang
|
4f00525057
|
fix: use e2e and unit test only for original repo or pr (#912)
|
2024-08-04 16:34:50 +10:00 |
|
|
Yineng Zhang
|
046c2b339e
|
chore: add multipart dep for fastapi (#895)
|
2024-08-03 00:50:19 +10:00 |
|
|
Yineng Zhang
|
6b8f66efe1
|
misc: update cuda graph capture exception log (#894)
|
2024-08-03 00:40:52 +10:00 |
|
|
Yineng Zhang
|
7937a886b2
|
docs: update setup runner (#884)
|
2024-08-02 21:03:53 +10:00 |
|
|
Yineng Zhang
|
2e218b9e04
|
fix: set env in runner (#891)
|
2024-08-02 20:48:56 +10:00 |
|
|
Yineng Zhang
|
aba6f51f88
|
misc: update unit test config (#873)
|
2024-08-02 05:27:05 +10:00 |
|
|
Yineng Zhang
|
7f6c690b67
|
misc: use pip cache purge and add unit test ci (#871)
|
2024-08-02 05:12:20 +10:00 |
|
|
Yineng Zhang
|
9e8d2c7f74
|
misc: add cancel previous at e2e (#864)
|
2024-08-01 18:26:54 +10:00 |
|
|
Yineng Zhang
|
c9bff5fcc8
|
misc: disable auto release (#862)
|
2024-08-01 17:46:51 +10:00 |
|
|
Yineng Zhang
|
3d617a21ba
|
misc: update e2e test paths config (#860)
|
2024-08-01 17:38:24 +10:00 |
|
|
Yineng Zhang
|
bc3eaac2b8
|
chore: update flashinfer to v0.1.3 (#850)
|
2024-08-01 04:37:05 +10:00 |
|
|
Yineng Zhang
|
a78d98de19
|
misc: update e2e test paths config (#848)
|
2024-07-31 18:37:29 +10:00 |
|
|
Yineng Zhang
|
1edd4e07d6
|
chore: bump v0.2.7 (#830)
|
2024-07-30 20:41:10 +10:00 |
|
|
Yineng Zhang
|
62c673c46f
|
docs: add set up runner (#829)
|
2024-07-30 19:43:40 +10:00 |
|
|
Yineng Zhang
|
377c5dc9a9
|
misc: enable e2e test when push (#828)
|
2024-07-30 19:26:23 +10:00 |
|
|
Yineng Zhang
|
f52eda35ea
|
misc: update e2e test benchmark config (#825)
|
2024-07-30 19:19:23 +10:00 |
|
|
Yineng Zhang
|
a30d5d75bf
|
feat: add pr e2e test (#822)
|
2024-07-30 18:31:26 +10:00 |
|
|
Yineng Zhang
|
17af39c5dc
|
feat: add runner (#821)
|
2024-07-30 17:32:13 +10:00 |
|
|
Yineng Zhang
|
bece265f5a
|
docs: update README (#819)
|
2024-07-30 16:17:50 +10:00 |
|
|
Yineng Zhang
|
a50c8a14b3
|
fix: use v0.2.5 for benchmark (#814)
|
2024-07-30 12:40:35 +10:00 |
|
|
Yineng Zhang
|
3d1cb0af83
|
feat: add chat template for internlm2-chat (#802)
|
2024-07-30 03:18:03 +08:00 |
|
|
Yineng Zhang
|
87064015d9
|
fix: update flashinfer to 0.1.2 to fix sampling for cu118 (#803)
|
2024-07-29 11:00:52 -07:00 |
|
|
Yineng Zhang
|
dd7e8b9421
|
chore: add copyright for srt (#790)
|
2024-07-28 23:07:12 +10:00 |
|
|
Yineng Zhang
|
1f013d64eb
|
docs: make badges center (#789)
|
2024-07-28 22:27:52 +10:00 |
|
|
Yineng Zhang
|
628e1fa760
|
docs: update README (#788)
|
2024-07-28 22:24:27 +10:00 |
|
|
Yineng Zhang
|
fa2aa0db0a
|
docs: update index (#786)
|
2024-07-28 17:22:00 +10:00 |
|
|
Yineng Zhang
|
6a387a69cc
|
fix: exclude logo png in gitignore (#785)
|
2024-07-28 17:08:16 +10:00 |
|
|
Yineng Zhang
|
27f5ce0a6c
|
fix: init readthedocs support (#784)
|
2024-07-28 16:55:54 +10:00 |
|
|
Yineng Zhang
|
948625799e
|
docs: init readthedocs support (#783)
|
2024-07-28 16:50:31 +10:00 |
|
|
Yineng Zhang
|
68e5262699
|
fix: replace pillow with PIL in PACKAGE_LIST (#781)
|
2024-07-28 14:06:24 +10:00 |
|
|
Yineng Zhang
|
de854fb5c5
|
feat: add fake tag (#770)
|
2024-07-28 02:22:22 +10:00 |
|
|
Yineng Zhang
|
a72342f180
|
fix: not run workflows on fork repo (#762)
|
2024-07-27 14:51:33 +10:00 |
|
|
Yineng Zhang
|
c3c74bf874
|
docs: update model support (#760)
|
2024-07-27 14:07:37 +10:00 |
|
|
Yineng Zhang
|
5bd06b4599
|
fix: use REPO_TOKEN (#755)
|
2024-07-27 05:56:30 +10:00 |
|
|
Yineng Zhang
|
9a61182732
|
fix: add release tag workflow (#754)
|
2024-07-27 05:48:38 +10:00 |
|
|
Yineng Zhang
|
eeb2482186
|
feat: add release tag workflow (#753)
|
2024-07-27 05:37:02 +10:00 |
|
|
Yineng Zhang
|
3e455b016e
|
misc: replace deprecated variable HUGGING_FACE_HUB_TOKEN with HF_TOKEN (#752)
|
2024-07-27 04:19:30 +10:00 |
|
|
Yineng Zhang
|
8628ab9c8b
|
feat: add docker workflow (#751)
|
2024-07-27 03:54:51 +10:00 |
|
|
Yineng Zhang
|
1b77670f39
|
chore: bump v0.2.1 (#740)
|
2024-07-26 21:27:41 +10:00 |
|
|
|
768e05d08f
|
fix benchmark (#743)
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
|
2024-07-26 21:26:13 +10:00 |
|
|
Yineng Zhang
|
01fbb11bb7
|
docs: fix typo (#742)
|
2024-07-26 21:05:53 +10:00 |
|
|
Yineng ZhangandYing1123
|
05d216da32
|
docs: add llama 3.1 405b instruction (#739)
Co-authored-by: Ying1123 <sqy1415@gmail.com>
|
2024-07-26 21:03:20 +10:00 |
|
|
Yineng Zhang
|
6b32bb1c0b
|
misc: format (#741)
|
2024-07-26 21:00:51 +10:00 |
|
|
Yineng Zhang
|
6010589783
|
misc: update bug issue template (#727)
|
2024-07-25 20:52:37 +10:00 |
|
|
Yineng Zhang
|
926ac01b64
|
fix: resolve the logo display issue on the PyPI page (#726)
|
2024-07-25 20:47:46 +10:00 |
|
|
Yineng Zhang
|
25c881a005
|
chore: bump v0.1.25 (#725)
|
2024-07-25 20:04:35 +10:00 |
|
|
Yineng Zhang
|
fded67441d
|
misc: update bulid instruction (#724)
|
2024-07-25 17:08:11 +10:00 |
|
|
Yineng Zhang
|
6e45394051
|
chore: add close inactive issues workflow (#722)
|
2024-07-25 16:31:23 +10:00 |
|
|
Yineng Zhang
|
97e0f7d250
|
docs: update comment (#721)
|
2024-07-25 10:51:18 +10:00 |
|
|
Yineng Zhang
|
d5146baec9
|
docs: update supported models (#719)
|
2024-07-25 09:34:01 +10:00 |
|
|
Yineng Zhang
|
321a963b01
|
misc: update doc (#715)
|
2024-07-24 13:05:46 -07:00 |
|
|
Yineng Zhang
|
e17deb27b5
|
fix: llama 3.1 405b fp8 (#714)
|
2024-07-24 09:37:41 -07:00 |
|
|
Yineng Zhang
|
2d3ae4e125
|
docs: update doc (#713)
|
2024-07-25 00:03:17 +10:00 |
|
|
Yineng Zhang
|
75f4ccb7dd
|
docs: update README (#712)
|
2024-07-24 23:33:28 +10:00 |
|
|
zhyncs
|
fa7ccb3316
|
feat: add e2e latency (#704)
|
2024-07-24 05:51:10 +10:00 |
|
|
zhyncs
|
9fdea29d05
|
misc: fix typo (#698)
|
2024-07-23 02:00:27 +10:00 |
|
|
zhyncs
|
d198791fe8
|
misc: update output token logic (#695)
|
2024-07-22 19:34:05 +10:00 |
|
|
zhyncs
|
c07526e46c
|
fix: update bench serving (#694)
|
2024-07-22 18:23:33 +10:00 |
|
|
zhyncs
|
7b597475f2
|
docs: update README (#692)
|
2024-07-22 03:41:20 +10:00 |
|