Parcourir la source

decoder frozen

Beto de Paola il y a 1 mois
Parent
commit
0d5328422f
1 fichiers modifiés avec 1 ajouts et 1 suppressions
  1. 1 1
      getting-started/finetuning/vision/11B_full_w2.yaml

+ 1 - 1
getting-started/finetuning/vision/11B_full_w2.yaml

@@ -4,7 +4,7 @@ output_dir: ./outputs/Llama-3.2-11B-Instruct-w2-full
 # Model
 model:
   _component_: torchtune.models.llama3_2_vision.llama3_2_vision_11b
-  decoder_trainable: True
+  decoder_trainable: False
   encoder_trainable: True
   fusion_trainable: True
   image_size: 560 # Make sure this matches the image_size in tokenizer