 Kai Wu
|
c18a0d277f
changed dataset to ocrvqa
|
vor 11 Monaten |
|
Kai Wu
|
ce299b3439
add get_custom_data_collator feature
|
vor 1 Jahr |
|
Kai Wu
|
12da109823
Merge branch 'main' into lmm_finetune
|
vor 1 Jahr |
|
Kai Wu
|
bb990be967
not working, need create dataloader function
|
vor 1 Jahr |
 Matthias Reso
|
778e31e35c
Fix checkpoint saving (#650)
|
vor 1 Jahr |
|
Kai Wu
|
b566582a86
finetune not working with fsdp
|
vor 1 Jahr |
 Kerim
|
9da9f01cdc
fixes
|
vor 1 Jahr |
|
Matthias Reso
|
4b93dc6080
Use RuntimeError instead assert
|
vor 1 Jahr |
|
Matthias Reso
|
091d58df17
Disable prefix tuning as its currently not supported; Limit llama_adapter usage to non-FSDP only
|
vor 1 Jahr |
|
Matthias Reso
|
17a6d16289
Test batching for both llama versions
|
vor 1 Jahr |
|
Matthias Reso
|
5a359b7bf2
Fix sampler vs batch_sampler
|
vor 1 Jahr |
|
Matthias Reso
|
a647955fc8
Make packing/padding a training setting
|
vor 1 Jahr |
|
Matthias Reso
|
10f9367e56
fix missing labels in datasets
|
vor 2 Jahren |
|
Matthias Reso
|
ddf58d205d
Added dist length based batch sampler
|
vor 2 Jahren |
|
Matthias Reso
|
ca41c1c697
Adjust tests to len based batch sampling
|
vor 2 Jahren |
 tim-a-davis
|
3038020aa4
Replaced ClassVar config param with field
|
vor 2 Jahren |
|
Matthias Reso
|
33c7738dcc
Added mechanism to supply a custom dataset without changing source files
|
vor 2 Jahren |
|
Matthias Reso
|
ce9501f22c
remove relative imports
|
vor 2 Jahren |
|
Matthias Reso
|
cf678b9bf0
Adjust imports to package structure + cleaned up imports
|
vor 2 Jahren |
|
Matthias Reso
|
4c9cc7d223
Move modules into separate src folder
|
vor 2 Jahren |
