瀏覽代碼

changing quantization from boolean to str to cover int4 and 8

HamidShojanazeri 1 年之前
父節點
當前提交
eb3f6555ad
共有 1 個文件被更改,包括 1 次插入1 次删除
  1. 1 1
      src/llama_recipes/configs/training.py

+ 1 - 1
src/llama_recipes/configs/training.py

@@ -35,7 +35,7 @@ class train_config:
     output_dir: str = "PATH/to/save/PEFT/model"
     freeze_layers: bool = False
     num_freeze_layers: int = 1
-    quantization: bool = False
+    quantization: str = None
     one_gpu: bool = False
     save_model: bool = True
     dist_checkpoint_root_folder: str="PATH/to/save/FSDP/model" # will be used if using FSDP