minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

docs: add Amazon SageMaker AI deployment guide (#28338)

Browse Source
This commit is contained in:
Jyothirmai Kottu
2026-06-16 13:33:22 -07:00
committed by GitHub
parent 9b4432fe18
commit b8b8992dde
3 changed files with 147 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs_new/docs/get-started/install.mdx
+3 -1
View File
@@ -167,7 +167,9 @@ sky status --endpoint 30000 sglang
To deploy on SGLang on AWS SageMaker, check out [AWS SageMaker Inference](https://aws.amazon.com/sagemaker/ai/deploy)
Amazon Web Services provide supports for SGLang containers along with routine security patching. For available SGLang containers, check out [AWS SGLang DLCs](https://github.com/aws/deep-learning-containers/blob/master/available_images.md#sglang-containers)
Amazon Web Services provide supports for SGLang containers along with routine security patching. For available SGLang containers, check out [AWS SGLang DLCs](https://aws.github.io/deep-learning-containers/reference/available_images/#sglang).
To deploy a pre-built SGLang Deep Learning Container without building your own image, see [Amazon SageMaker AI](/docs/basic_usage/aws_sagemaker).
To host a model with your own container, follow the following steps: