 Yineng Zhang
|
aaf0a3156e
|
docs: add slides link in README (#1997)
|
2024-11-11 05:03:16 -08:00 |
|
|
Yineng Zhang
|
47ffe7af81
|
docs: add shm size for docker run (#1986)
|
2024-11-10 22:14:48 +08:00 |
|
|
Yineng Zhang
|
b3523af8eb
|
fix: update pyzmq version (#1983)
|
2024-11-10 21:33:23 +08:00 |
|
|
Yineng Zhang
|
793b79dbe9
|
feat: support truss endpoint for benchmark serving (#1906)
|
2024-11-03 12:56:10 -08:00 |
|
|
Yineng Zhang
|
104bf2609b
|
minor: update nightly eval (#1867)
|
2024-11-01 21:38:29 +08:00 |
|
|
Yineng Zhang
|
d86a2d6562
|
minor: add human eval (#1754)
|
2024-11-01 14:29:20 +08:00 |
|
|
Yineng Zhang
|
e68b9e7667
|
misc: add CODEOWNERS (#1737)
|
2024-10-21 06:28:32 -07:00 |
|
|
|
cbbc82b7b8
|
Support qwen2 vl model (#1721)
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ispobock <ISPObaoke@163.com>
|
2024-10-19 21:44:38 -07:00 |
|
|
Yineng ZhangandKe Bao
|
8bee20f80b
|
Update vllm to 0.6.3 (#1711) (#1720)
Co-authored-by: Ke Bao <ISPObaoke@163.com>
|
2024-10-19 20:45:41 -07:00 |
|
|
Yineng Zhang
|
42a2d82ba7
|
minor: add mla fp8 test (#1494)
|
2024-09-23 20:40:17 +08:00 |
|
|
Yineng Zhang
|
441c22db8c
|
doc: update backend (#1486)
|
2024-09-21 22:05:12 +08:00 |
|
|
Yineng Zhang
|
82136eb0b5
|
chore: bump v0.3.1.post3 (#1483)
|
2024-09-21 11:17:45 +08:00 |
|
|
Yineng Zhang
|
a6db88626e
|
minor: add quant eval compared with base (#1475)
|
2024-09-20 01:57:19 +08:00 |
|
|
Yineng Zhang
|
b4408b0d16
|
feat: update linear deps 1/N (#1305)
|
2024-09-19 20:53:11 +08:00 |
|
|
Yineng Zhang
|
e3fc4658f4
|
fix: resolve nightly eval (#1426)
|
2024-09-15 02:07:52 +10:00 |
|
|
Yineng Zhang
|
f3d32f888a
|
ci: fix finish (#1414)
|
2024-09-14 01:01:30 +10:00 |
|
|
Yineng Zhang
|
62f15eea5a
|
docs: add conclusion (#1340)
|
2024-09-06 04:25:14 +10:00 |
|
|
Yineng Zhang
|
79794af52d
|
docs: highlight ttft itl and throughput (#1337)
|
2024-09-06 00:00:06 +10:00 |
|
|
Yineng Zhang
|
3494b32c3a
|
docs: update README (#1336)
|
2024-09-05 23:39:44 +10:00 |
|
|
Yineng Zhang
|
5ab9418f5b
|
[Doc] update news (#1327)
|
2024-09-04 04:21:21 -07:00 |
|
|
Yineng Zhang
|
a63c8275c6
|
chore: bump v0.3.0 (#1320)
|
2024-09-04 04:32:18 +08:00 |
|
|
Yineng Zhangandispobock
|
dc67d97693
|
misc: speedup load safetensors (#1319)
Co-authored-by: ispobock <ISPObaoke@163.com>
|
2024-09-04 04:29:53 +10:00 |
|
|
Yineng Zhang
|
2561ed012c
|
feat: update nightly gsm8k eval (#1304)
|
2024-09-03 01:18:41 +10:00 |
|
|
Yineng Zhang
|
6487ef64c6
|
ci: add nightly eval (#1291)
|
2024-09-02 03:19:49 +10:00 |
|
|
Yineng Zhang
|
9b0805242e
|
fix: resolve fp8 for mixtral (#1290)
|
2024-09-02 00:29:06 +10:00 |
|
|
Yineng Zhangandispobock
|
54772f784a
|
feat: fix fp8 for MLA and support bmm fp8 for DeepSeek V2 (#1285)
Co-authored-by: ispobock <ispobaoke@163.com>
|
2024-09-01 17:28:06 +10:00 |
|
|
Yineng Zhang
|
52cefdbf57
|
fix: resolve the fp8 bug introduced by vLLM 0.5.5 (#1276)
|
2024-09-01 00:44:29 +10:00 |
|
|
Yineng Zhang
|
13ac95b894
|
chore: bump v0.2.14.post2 (#1250)
|
2024-08-28 18:46:33 +00:00 |
|
|
Yineng Zhang
|
492143bf32
|
fix: resolve qwen2 moe weight loader (#1252)
|
2024-08-28 11:25:46 -07:00 |
|
|
Yineng Zhang
|
c411f32e1c
|
feat: replace GeluAndMul (#1234)
|
2024-08-28 14:07:02 +00:00 |
|
|
Yineng Zhang
|
b1a540ec42
|
feat: update GemmaRMSNorm (#1232)
|
2024-08-28 22:47:34 +10:00 |
|
|
Yineng Zhang
|
66975360e7
|
fix: increase max_new_tokens when testing generation models (#1244)
|
2024-08-28 22:12:36 +10:00 |
|
|
Yineng Zhang
|
f25f4dfde5
|
hotfix: revert sampler CUDA Graph (#1242)
|
2024-08-28 21:16:47 +10:00 |
|
|
Yineng Zhang
|
198974cd1a
|
feat: support sm75 with FlashInfer v0.1.6 (#1233)
|
2024-08-28 18:39:12 +10:00 |
|
|
Yineng Zhang
|
3602692c7c
|
feat: replace get_act_fn for gpt_bigcode (#1231)
|
2024-08-27 21:15:31 +10:00 |
|
|
Yineng Zhang
|
c5fe11a8e1
|
chore: bump v0.2.14 (#1155)
|
2024-08-27 00:28:24 +10:00 |
|
|
Yineng Zhang
|
c9064e6fd9
|
feat: use gelu_tanh_and_mul (#1193)
|
2024-08-24 01:58:16 -07:00 |
|
|
Yineng Zhang
|
1fb9459908
|
fix: custom op fallback forward native when lower sm80 (#1177)
|
2024-08-21 14:26:35 -07:00 |
|
|
Yineng Zhang
|
350a81609b
|
fix: resolve README render (#1166)
|
2024-08-21 03:23:52 +10:00 |
|
|
Yineng Zhang
|
04707b09b7
|
misc: add hypervisor vendor (#1165)
|
2024-08-21 02:14:51 +10:00 |
|
|
Yineng Zhang
|
9208591f05
|
fix: use fp16 dtype for sm75 (#1136)
|
2024-08-18 00:45:42 +10:00 |
|
|
Yineng Zhang
|
6aa8ad14f8
|
fix: resolve Python.h header missing (#1119)
|
2024-08-16 15:46:43 +10:00 |
|
|
Yineng Zhang
|
26e9c12c15
|
ci: compatible with fork repo (#1115)
|
2024-08-16 04:26:44 +10:00 |
|
|
Yineng Zhang
|
5bd953749b
|
chore: bump v0.2.13 (#1111)
|
2024-08-16 03:50:43 +10:00 |
|
|
Yineng Zhang
|
9195d1362a
|
misc: rm unused model_loader (#1110)
|
2024-08-15 08:29:35 -07:00 |
|
|
Yineng Zhang
|
1c2b5f5240
|
docs: update nsys usage (#1103)
|
2024-08-15 01:39:15 +08:00 |
|
|
Yineng Zhang
|
67c0d832a6
|
docs: update pr template (#1099)
|
2024-08-14 22:25:39 +10:00 |
|
|
Yineng Zhang
|
fe5024325b
|
docs: update README (#1098)
|
2024-08-14 04:40:05 -07:00 |
|
|
Yineng Zhang
|
f14569f64a
|
ci: remove workflow path trigger (#1096)
|
2024-08-14 20:36:24 +10:00 |
|
|
Yineng ZhangandLiangsheng Yin
|
c8423ca311
|
ci: update timeout and retry (#1086)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2024-08-14 00:27:35 -07:00 |
|
|
Yineng Zhang
|
cebd78d83e
|
ci: add accuracy timeout (#1078)
|
2024-08-13 22:12:58 +10:00 |
|
|
Yineng Zhang
|
0076f11541
|
fix: use devel for Triton's compiler requirements (#1074)
|
2024-08-13 04:08:43 -07:00 |
|
|
Yineng Zhang
|
f7fb68d292
|
ci: add moe test (#1053)
|
2024-08-13 18:43:23 +10:00 |
|
|
Yineng Zhang
|
396a13e6ad
|
ci: add cancel pr workflow (#1070)
|
2024-08-13 18:16:50 +10:00 |
|
|
Yineng Zhangandispobock
|
65915f9f3e
|
fix: temporary solution for DeepSeek V2 H100 layout conversion issue (#1060)
Co-authored-by: ispobock <ISPObaoke@163.com>
|
2024-08-13 15:48:54 +10:00 |
|
|
Yineng Zhang
|
65e89baea9
|
fix: not use the default port (#1068)
|
2024-08-13 15:12:56 +10:00 |
|
|
Yineng Zhang
|
6a38efa834
|
feat: replace all rmsnorm and silu (#1057)
|
2024-08-13 02:15:59 +10:00 |
|
|
Yineng Zhang
|
b0ad0c1bc8
|
chore: bump v0.2.12 (#1048)
|
2024-08-12 20:59:38 +10:00 |
|
|
Yineng Zhang
|
89f23a5178
|
docs: update setup github runner (#1050)
|
2024-08-12 18:11:38 +10:00 |
|
|
Yineng Zhangandvhain
|
cb99ba4fc6
|
feat: update Dockerfile (#1033)
Co-authored-by: vhain <vhain6512@gmail.com>
|
2024-08-12 16:24:06 +10:00 |
|
|
Yineng Zhang
|
c245b78973
|
hotfix: add CustomOp abstraction (#1027)
|
2024-08-11 02:45:59 -07:00 |
|
|
Yineng Zhang
|
33d61356b8
|
misc: update issue template (#1024)
|
2024-08-11 17:34:30 +10:00 |
|
|
Yineng Zhang
|
94752ac811
|
feat: use FlashInfer rmsnorm and silu (#907)
|
2024-08-11 14:57:13 +10:00 |
|
|
Yineng Zhang
|
e712837d38
|
misc: update test config (#990)
|
2024-08-11 04:20:30 +10:00 |
|
|
Yineng Zhang
|
b568df5d03
|
fix: resolve correctness_test issue (#1002)
|
2024-08-09 23:21:42 +10:00 |
|
|
Yineng Zhang
|
dc9d06d886
|
chore: bump v0.2.11 (#970)
|
2024-08-07 20:47:53 +08:00 |
|
|
Yineng Zhang
|
c31f084c71
|
chore: update vllm to 0.5.4 (#966)
|
2024-08-07 21:15:41 +10:00 |
|
|
Yineng Zhang
|
05abd1261c
|
misc: add compute capability in check_env (#965)
|
2024-08-07 18:39:36 +10:00 |
|
|
Yineng Zhang
|
58a0970853
|
misc: update issue template (#963)
|
2024-08-07 17:41:21 +10:00 |
|
|
Yineng Zhang
|
fde8340550
|
docs: update README (#935)
|
2024-08-05 20:06:06 +10:00 |
|
|
Yineng Zhang
|
f4d9953d9d
|
misc: add triton in check_env PACKAGE_LIST (#914)
|
2024-08-04 23:20:59 +10:00 |
|
|
Yineng Zhang
|
4f00525057
|
fix: use e2e and unit test only for original repo or pr (#912)
|
2024-08-04 16:34:50 +10:00 |
|
|
Yineng Zhang
|
046c2b339e
|
chore: add multipart dep for fastapi (#895)
|
2024-08-03 00:50:19 +10:00 |
|
|
Yineng Zhang
|
6b8f66efe1
|
misc: update cuda graph capture exception log (#894)
|
2024-08-03 00:40:52 +10:00 |
|
|
Yineng Zhang
|
7937a886b2
|
docs: update setup runner (#884)
|
2024-08-02 21:03:53 +10:00 |
|
|
Yineng Zhang
|
2e218b9e04
|
fix: set env in runner (#891)
|
2024-08-02 20:48:56 +10:00 |
|
|
Yineng Zhang
|
aba6f51f88
|
misc: update unit test config (#873)
|
2024-08-02 05:27:05 +10:00 |
|
|
Yineng Zhang
|
7f6c690b67
|
misc: use pip cache purge and add unit test ci (#871)
|
2024-08-02 05:12:20 +10:00 |
|
|
Yineng Zhang
|
9e8d2c7f74
|
misc: add cancel previous at e2e (#864)
|
2024-08-01 18:26:54 +10:00 |
|
|
Yineng Zhang
|
c9bff5fcc8
|
misc: disable auto release (#862)
|
2024-08-01 17:46:51 +10:00 |
|
|
Yineng Zhang
|
3d617a21ba
|
misc: update e2e test paths config (#860)
|
2024-08-01 17:38:24 +10:00 |
|
|
Yineng Zhang
|
bc3eaac2b8
|
chore: update flashinfer to v0.1.3 (#850)
|
2024-08-01 04:37:05 +10:00 |
|
|
Yineng Zhang
|
a78d98de19
|
misc: update e2e test paths config (#848)
|
2024-07-31 18:37:29 +10:00 |
|
|
Yineng Zhang
|
1edd4e07d6
|
chore: bump v0.2.7 (#830)
|
2024-07-30 20:41:10 +10:00 |
|
|
Yineng Zhang
|
62c673c46f
|
docs: add set up runner (#829)
|
2024-07-30 19:43:40 +10:00 |
|
|
Yineng Zhang
|
377c5dc9a9
|
misc: enable e2e test when push (#828)
|
2024-07-30 19:26:23 +10:00 |
|
|
Yineng Zhang
|
f52eda35ea
|
misc: update e2e test benchmark config (#825)
|
2024-07-30 19:19:23 +10:00 |
|
|
Yineng Zhang
|
a30d5d75bf
|
feat: add pr e2e test (#822)
|
2024-07-30 18:31:26 +10:00 |
|
|
Yineng Zhang
|
17af39c5dc
|
feat: add runner (#821)
|
2024-07-30 17:32:13 +10:00 |
|
|
Yineng Zhang
|
bece265f5a
|
docs: update README (#819)
|
2024-07-30 16:17:50 +10:00 |
|
|
Yineng Zhang
|
a50c8a14b3
|
fix: use v0.2.5 for benchmark (#814)
|
2024-07-30 12:40:35 +10:00 |
|
|
Yineng Zhang
|
3d1cb0af83
|
feat: add chat template for internlm2-chat (#802)
|
2024-07-30 03:18:03 +08:00 |
|
|
Yineng Zhang
|
87064015d9
|
fix: update flashinfer to 0.1.2 to fix sampling for cu118 (#803)
|
2024-07-29 11:00:52 -07:00 |
|
|
Yineng Zhang
|
dd7e8b9421
|
chore: add copyright for srt (#790)
|
2024-07-28 23:07:12 +10:00 |
|
|
Yineng Zhang
|
1f013d64eb
|
docs: make badges center (#789)
|
2024-07-28 22:27:52 +10:00 |
|
|
Yineng Zhang
|
628e1fa760
|
docs: update README (#788)
|
2024-07-28 22:24:27 +10:00 |
|
|
Yineng Zhang
|
fa2aa0db0a
|
docs: update index (#786)
|
2024-07-28 17:22:00 +10:00 |
|
|
Yineng Zhang
|
6a387a69cc
|
fix: exclude logo png in gitignore (#785)
|
2024-07-28 17:08:16 +10:00 |
|
|
Yineng Zhang
|
27f5ce0a6c
|
fix: init readthedocs support (#784)
|
2024-07-28 16:55:54 +10:00 |
|
|
Yineng Zhang
|
948625799e
|
docs: init readthedocs support (#783)
|
2024-07-28 16:50:31 +10:00 |
|