docs: update usage (#15142)
This commit is contained in:
@@ -1,6 +1,6 @@
|
|||||||
# SGL Kernel
|
# sgl-kernel
|
||||||
|
|
||||||
[Kernel Library](https://github.com/sgl-project/sglang/tree/main/sgl-kernel) for SGLang
|
[Kernel Library](https://github.com/sgl-project/sglang/tree/main/sgl-kernel) for LLM inference engines
|
||||||
|
|
||||||
<div align="center">
|
<div align="center">
|
||||||
|
|
||||||
@@ -9,7 +9,7 @@
|
|||||||
|
|
||||||
</div>
|
</div>
|
||||||
|
|
||||||
SGL Kernel provides optimized compute primitives for the SGLang framework, enabling efficient inference for large language models and vision-language models through custom kernel operations.
|
sgl-kernel provides optimized compute primitives for LLM inference engines, enabling efficient inference for large language models and vision-language models through custom kernel operations. It has been used by [LightLLM](https://github.com/ModelTC/LightLLM), [SGLang](https://github.com/sgl-project/sglang) and so on.
|
||||||
|
|
||||||
## Installation
|
## Installation
|
||||||
Requires torch == 2.9.1
|
Requires torch == 2.9.1
|
||||||
|
|||||||
Reference in New Issue
Block a user