 Kai Wu
|
bb990be967
not working, need create dataloader function
|
hai 7 meses |
|
Kai Wu
|
b566582a86
finetune not working with fsdp
|
hai 8 meses |
 Kerim
|
9da9f01cdc
fixes
|
hai 1 ano |
 Matthias Reso
|
4b93dc6080
Use RuntimeError instead assert
|
hai 1 ano |
|
Matthias Reso
|
091d58df17
Disable prefix tuning as its currently not supported; Limit llama_adapter usage to non-FSDP only
|
hai 1 ano |
|
Matthias Reso
|
17a6d16289
Test batching for both llama versions
|
hai 1 ano |
|
Matthias Reso
|
5a359b7bf2
Fix sampler vs batch_sampler
|
hai 1 ano |
|
Matthias Reso
|
a647955fc8
Make packing/padding a training setting
|
hai 1 ano |
|
Matthias Reso
|
10f9367e56
fix missing labels in datasets
|
hai 1 ano |
|
Matthias Reso
|
ddf58d205d
Added dist length based batch sampler
|
hai 1 ano |
|
Matthias Reso
|
ca41c1c697
Adjust tests to len based batch sampling
|
hai 1 ano |
 tim-a-davis
|
3038020aa4
Replaced ClassVar config param with field
|
hai 1 ano |
|
Matthias Reso
|
33c7738dcc
Added mechanism to supply a custom dataset without changing source files
|
hai 1 ano |
|
Matthias Reso
|
ce9501f22c
remove relative imports
|
hai 1 ano |
|
Matthias Reso
|
cf678b9bf0
Adjust imports to package structure + cleaned up imports
|
hai 1 ano |
|
Matthias Reso
|
4c9cc7d223
Move modules into separate src folder
|
hai 1 ano |
