Browse Source

add note on h200 issue

Kai Wu 1 month ago
parent
commit
6eae14298b
1 changed files with 2 additions and 0 deletions
  1. 2 0
      getting-started/finetuning/finetune_llama4.md

+ 2 - 0
getting-started/finetuning/finetune_llama4.md

@@ -12,9 +12,11 @@ cd torchtune
 git checkout 5d51c25cedfb6ba7b00e03cb2fef4f9cdb7baebd
 git checkout 5d51c25cedfb6ba7b00e03cb2fef4f9cdb7baebd
 pip install -e .
 pip install -e .
 ```
 ```
+**Note**: This recipe has been tested working with H100 and A100. We have run into problems with H200 due to some Pytorch support issues.
 
 
 2. We also need Hugging Face access token (HF_TOKEN) for model download, please follow the instructions [here](https://huggingface.co/docs/hub/security-tokens) to get your own token. You will also need to gain model access to Llama4 models from [here](https://huggingface.co/collections/meta-llama/llama-4-67f0c30d9fe03840bc9d0164)
 2. We also need Hugging Face access token (HF_TOKEN) for model download, please follow the instructions [here](https://huggingface.co/docs/hub/security-tokens) to get your own token. You will also need to gain model access to Llama4 models from [here](https://huggingface.co/collections/meta-llama/llama-4-67f0c30d9fe03840bc9d0164)
 
 
+
 ### Steps
 ### Steps
 1. **Download Llama4 Weights**
 1. **Download Llama4 Weights**