minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity

[sgl-kernel] Prep for torch 2.11 upgrade and switch PyPI default to cu130 (#24162)

Browse Source 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
This commit is contained in:
Kangyan-Zhou
2026-04-30 14:54:39 -07:00
committed by GitHub
co-authored by Claude Opus 4.7 Baizhou Zhang
parent c04b20dc88
commit 340efca244
4 changed files with 40 additions and 44 deletions
Download Patch File Download Diff File Expand all files Collapse all files
sgl-kernel/Dockerfile
+4 -4
View File
@@ -79,10 +79,10 @@ RUN set -eux; \
RUN --mount=type=cache,id=sgl-kernel-pip,target=/root/.cache/pip \
set -eux; \
case "${CUDA_VERSION}" in \
13.0) TORCH_VER=2.9.1; CU_TAG=cu130 ;; \
12.9) TORCH_VER=2.9.1; CU_TAG=cu128 ;; \
12.8) TORCH_VER=2.9.1; CU_TAG=cu128 ;; \
*) TORCH_VER=2.9.1; CU_TAG=cu126 ;; \
13.0) TORCH_VER=2.11.0; CU_TAG=cu130 ;; \
12.9) TORCH_VER=2.11.0; CU_TAG=cu129 ;; \
12.8) TORCH_VER=2.11.0; CU_TAG=cu128 ;; \
*) TORCH_VER=2.11.0; CU_TAG=cu126 ;; \
esac; \
${PYTHON_ROOT_PATH}/bin/pip install torch==${TORCH_VER} --index-url https://${PYTORCH_MIRROR}/whl/${CU_TAG}; \
${PYTHON_ROOT_PATH}/bin/pip install ninja setuptools==75.0.0 wheel==0.41.0 numpy uv scikit-build-core --index-url ${PIP_DEFAULT_INDEX}
sgl-kernel/README.md
+1 -1
View File
@@ -12,7 +12,7 @@
`sglang-kernel` provides optimized compute primitives for LLM inference engines, enabling efficient inference for large language models and vision-language models through custom kernel operations. The source tree remains under the `sgl-kernel/` directory and the Python import path remains `sgl_kernel`.
## Installation
Requires torch == 2.9.1
Requires torch == 2.11.0
```bash
# Latest version