Suraj Subramanian
|
c4eacac06d
hf conversion updates
|
1 year ago |
Suraj Subramanian
|
6ade4ebe85
update readme for 3.2
|
1 year ago |
Kai Wu
|
50dff0b78e
gradient_checkpointing_enable()
|
1 year ago |
Kai Wu
|
210e719a40
add word to wordlist.txt
|
1 year ago |
Kai Wu
|
c18a0d277f
changed dataset to ocrvqa
|
1 year ago |
Sanyam Bhutani
|
b6d49b452b
Create multi_modal_infer.py
|
1 year ago |
Kai Wu
|
bd22f407d5
changed to aid2 dataset
|
1 year ago |
Kai Wu
|
1a76080807
lora+fsdp working
|
1 year ago |
Kai Wu
|
8a11b48022
lora+fsdp not working
|
1 year ago |
Kai Wu
|
79dbe05a94
batch fine-tuning lmm working
|
1 year ago |
Kai Wu
|
ce299b3439
add get_custom_data_collator feature
|
1 year ago |
Kai Wu
|
12da109823
Merge branch 'main' into lmm_finetune
|
1 year ago |
Kai Wu
|
bb990be967
not working, need create dataloader function
|
1 year ago |
Matthias Reso
|
d9939cd0cf
Fix to take bos into account
|
1 year ago |
Kai Wu
|
c38cccb66f
readme draft
|
1 year ago |
Matthias Reso
|
3c9f263c79
Mask out assistant header
|
1 year ago |
Suraj Subramanian
|
acac5257cd
Merge branch 'main' of https://github.com/meta-llama/llama-recipes into llama-triage-tool
|
1 year ago |
Suraj Subramanian
|
713206fdab
improve readability, logging, fix spellcheck test
|
1 year ago |
Matthias Reso
|
a38a80a252
Remove debug prints
|
1 year ago |
Matthias Reso
|
d45222ec1a
Add unit test for tokenizer_dialog for custom dataset
|
1 year ago |
Matthias Reso
|
dadadf8387
Fix custom dataset after default system prompt was added
|
1 year ago |
varunfb
|
bfc5a8f2ca
Update requirements.txt
|
1 year ago |
Jeff Tang
|
3e39ed05bd
Update get_default_finetune_args.py (#662)
|
1 year ago |
Kai Wu
|
abe44c0237
fix the idx issue for labels
|
1 year ago |
Eda Z
|
9b3c4f8d50
Update get_default_finetune_args.py
|
1 year ago |
Gautam Kumar
|
ccd4741084
Adding custom dataset file (#659)
|
1 year ago |
Matthias Reso
|
778e31e35c
Fix checkpoint saving (#650)
|
1 year ago |
Kai Wu
|
576e574e31
update readme
|
1 year ago |
Kai Wu
|
ee204ccb98
working now
|
1 year ago |
Kai Wu
|
b566582a86
finetune not working with fsdp
|
1 year ago |