 Kai Wu
|
bd31680eb9
fixed the missing processor after conversion
|
vor 11 Monaten |
 Sanyam Bhutani
|
b554b24b6e
Fix/unit test 3.2 (#726)
|
vor 11 Monaten |
 Patrik Lambert
|
f521c93d56
Fix numpy seed in finetuning.py
|
vor 11 Monaten |
 Matthias Reso
|
1090ccf455
Fix test_finetuning
|
vor 11 Monaten |
 Huang Zhihong
|
a620831762
Fix the bug when continue the peft. (#717)
|
vor 11 Monaten |
|
Kai Wu
|
9c7a5b421f
fix AutoModel and bump transformers version to 4.45 (#686)
|
vor 11 Monaten |
|
Kai Wu
|
57afa0b51e
use AutoModel
|
vor 11 Monaten |
|
Kai Wu
|
2730bcaab7
fix readme and fsdp logic
|
vor 11 Monaten |
|
Kai Wu
|
50dff0b78e
gradient_checkpointing_enable()
|
vor 11 Monaten |
|
Kai Wu
|
c18a0d277f
changed dataset to ocrvqa
|
vor 11 Monaten |
|
Kai Wu
|
bd22f407d5
changed to aid2 dataset
|
vor 11 Monaten |
|
Kai Wu
|
1a76080807
lora+fsdp working
|
vor 11 Monaten |
|
Kai Wu
|
8a11b48022
lora+fsdp not working
|
vor 1 Jahr |
|
Kai Wu
|
79dbe05a94
batch fine-tuning lmm working
|
vor 1 Jahr |
|
Kai Wu
|
ce299b3439
add get_custom_data_collator feature
|
vor 1 Jahr |
|
Kai Wu
|
12da109823
Merge branch 'main' into lmm_finetune
|
vor 1 Jahr |
|
Kai Wu
|
bb990be967
not working, need create dataloader function
|
vor 1 Jahr |
|
Matthias Reso
|
778e31e35c
Fix checkpoint saving (#650)
|
vor 1 Jahr |
|
Kai Wu
|
ee204ccb98
working now
|
vor 1 Jahr |
|
Kai Wu
|
b566582a86
finetune not working with fsdp
|
vor 1 Jahr |
 Hamid Shojanazeri
|
808a3f7a0c
Adding support for FSDP+Qlora. (#572)
|
vor 1 Jahr |
 haozhx23
|
e6b0f97199
Fix hsdp_device_mesh=None when enable HSDP and HYBRID_SHARD (#402)
|
vor 1 Jahr |
|
Kai Wu
|
41a46d811d
fix alpaca dataset by using 5% of the data as eval and make sure len((eval_loader)>0
|
vor 1 Jahr |
|
Kai Wu
|
f1d90d0ff0
fix wandb config update
|
vor 1 Jahr |
|
Kai Wu
|
480c4f2b5e
resume the finetuning given the path of the previous peft checkpoint folder
|
vor 1 Jahr |
 Merovingian
|
b4e1a420c8
Freeze layer bug fix
|
vor 1 Jahr |
 Pavel Belevich
|
fb2e802cef
Fix param_init_fn: move if-statement out of lambda
|
vor 1 Jahr |
 Beto
|
65559c1640
Merge branch 'main' of github.com:albertodepaola/llama-recipes-private into main
|
vor 1 Jahr |
|
Matthias Reso
|
43cb6a2db4
Remove check for nighlies for low_cpu_fsdp and bump torch version to 2.2 instead
|
vor 1 Jahr |
|
Matthias Reso
|
113ea18bf1
Replace LlamaTokenizer with AutoTokenizer
|
vor 1 Jahr |
