Skip to content

Commit

Permalink
refine docs
Browse files Browse the repository at this point in the history
  • Loading branch information
xinfei.sxf committed Mar 25, 2024
1 parent 4b82ab2 commit 65fc197
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/DeployDocker.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ git clone https://github.com/alibaba/rtp-llm.git
cd docker
# 注意:以下两条指令,不要使用sudo执行
# 如果是cuda11的环境,CONTAINER_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda11
# 如果是cuda11的环境,CONTAINER_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda12
# 如果是cuda12的环境,CONTAINER_NAME为registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:deploy_image_cuda12
sh ./create_container.sh <CONTAINER_NAME>
sh CONTAINER_NAME/sshme.sh
```
Expand All @@ -27,4 +27,4 @@ TOKENIZER_PATH=/path/to/tokenizer CHECKPOINT_PATH=/path/to/model MODEL_TYPE=your
# request to server
curl -XPOST http://localhost:8088 -d '{"prompt": "hello, what is your name", "generate_config": {"max_new_tokens": 1000}}'
```
其中 your_model_type 可以在 maga_transformer/models/__init__.py 中查找到
其中 your_model_type 可以在 maga_transformer/models/__init__.py 中查找到

0 comments on commit 65fc197

Please sign in to comment.