소스 검색

change gpu parallel size docs

Justin Lee 3 달 전
부모
커밋
03f2b8eddd
1개의 변경된 파일1개의 추가작업 그리고 1개의 파일을 삭제
  1. 1 1
      end-to-end-use-cases/prompt-migration/README.md

+ 1 - 1
end-to-end-use-cases/prompt-migration/README.md

@@ -30,7 +30,7 @@ The **Prompt Migration** toolkit helps you assess and adapt prompts across diffe
    ```
    To serve a large model (example: Meta’s Llama 3.3 70B Instruct), you might run:
    ```bash
-   vllm serve meta-llama/Llama-3.3-70B-Instruct --tensor-parallel-size=2
+   vllm serve meta-llama/Llama-3.3-70B-Instruct --tensor-parallel-size=4
    ```
    Adjust the model name and `--tensor-parallel-size` according to your hardware and parallelization needs.