 Kai Wu
|
9c7a5b421f
fix AutoModel and bump transformers version to 4.45 (#686)
|
hai 8 meses |
|
Kai Wu
|
57afa0b51e
use AutoModel
|
hai 8 meses |
|
Kai Wu
|
2730bcaab7
fix readme and fsdp logic
|
hai 8 meses |
|
Kai Wu
|
50dff0b78e
gradient_checkpointing_enable()
|
hai 8 meses |
|
Kai Wu
|
c18a0d277f
changed dataset to ocrvqa
|
hai 8 meses |
|
Kai Wu
|
bd22f407d5
changed to aid2 dataset
|
hai 8 meses |
|
Kai Wu
|
1a76080807
lora+fsdp working
|
hai 8 meses |
|
Kai Wu
|
8a11b48022
lora+fsdp not working
|
hai 8 meses |
|
Kai Wu
|
79dbe05a94
batch fine-tuning lmm working
|
hai 8 meses |
|
Kai Wu
|
ce299b3439
add get_custom_data_collator feature
|
hai 8 meses |
|
Kai Wu
|
12da109823
Merge branch 'main' into lmm_finetune
|
hai 8 meses |
|
Kai Wu
|
bb990be967
not working, need create dataloader function
|
hai 8 meses |
 Matthias Reso
|
778e31e35c
Fix checkpoint saving (#650)
|
hai 9 meses |
|
Kai Wu
|
ee204ccb98
working now
|
hai 9 meses |
|
Kai Wu
|
b566582a86
finetune not working with fsdp
|
hai 9 meses |
 Hamid Shojanazeri
|
808a3f7a0c
Adding support for FSDP+Qlora. (#572)
|
hai 10 meses |
 haozhx23
|
e6b0f97199
Fix hsdp_device_mesh=None when enable HSDP and HYBRID_SHARD (#402)
|
hai 11 meses |
|
Kai Wu
|
41a46d811d
fix alpaca dataset by using 5% of the data as eval and make sure len((eval_loader)>0
|
hai 1 ano |
|
Kai Wu
|
f1d90d0ff0
fix wandb config update
|
hai 1 ano |
|
Kai Wu
|
480c4f2b5e
resume the finetuning given the path of the previous peft checkpoint folder
|
hai 1 ano |
 Merovingian
|
b4e1a420c8
Freeze layer bug fix
|
hai 1 ano |
 Pavel Belevich
|
fb2e802cef
Fix param_init_fn: move if-statement out of lambda
|
hai 1 ano |
 Beto
|
65559c1640
Merge branch 'main' of github.com:albertodepaola/llama-recipes-private into main
|
hai 1 ano |
|
Matthias Reso
|
43cb6a2db4
Remove check for nighlies for low_cpu_fsdp and bump torch version to 2.2 instead
|
hai 1 ano |
|
Matthias Reso
|
113ea18bf1
Replace LlamaTokenizer with AutoTokenizer
|
hai 1 ano |
 Rahul A R
|
f8183b96fe
use new tokenizer_name argument and resize embeddings if required
|
hai 1 ano |
|
Hamid Shojanazeri
|
11f51db28c
adding the kbit prep in the code
|
hai 1 ano |
|
Hamid Shojanazeri
|
f058ff6ccd
update due to peft new release
|
hai 1 ano |
|
Hamid Shojanazeri
|
ffdc93f00a
Merge branch 'main' into wandb_logging
|
hai 1 ano |
|
Matthias Reso
|
c5a382e509
Make tests run on cpu only machines
|
hai 1 ano |
