 Beto
|
92be45b0fe
Adding matplotlib to requirements. Removing import from train_utils
|
%!s(int64=2) %!d(string=hai) anos |
 Anshika
|
b8d327f7c3
Update grammar_dataset_process.ipynb
|
%!s(int64=2) %!d(string=hai) anos |
|
Anshika
|
fecfece7e3
Update grammar_dataset_process.ipynb
|
%!s(int64=2) %!d(string=hai) anos |
|
Beto
|
80a6ac41b5
Adding the rank to the metrics filename to differentiate the run from each GPU
|
%!s(int64=2) %!d(string=hai) anos |
|
Beto
|
2f7256918e
Adding support to save fine tuning metrics to json. Adding script to plot saved metrics.
|
%!s(int64=2) %!d(string=hai) anos |
 Geeta Chauhan
|
18e0198626
Make tests run on cpu instance (#212)
|
%!s(int64=2) %!d(string=hai) anos |
 Matthias Reso
|
584bc93609
Make tests run on cpu instance
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
eafea7b366
Invalidate labels in dialog dataset to disable loss
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
cc8cc0d3c3
fix grammar dataset
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
2e4bd2a665
Resize vocab size to fix idx error
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
10f9367e56
fix missing labels in datasets
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
f2d02a9362
Add unit test for dis sampler
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
be63d9ec39
Remove padding in alpaca ds; remove concat in grammar
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
ddf58d205d
Added dist length based batch sampler
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
ca41c1c697
Adjust tests to len based batch sampling
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
97a7871f4b
Fix seed in test
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
17209cdabd
Add license to test file
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
d5054ecae9
Move sampler test
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
63ce4ce7f6
Moved sampler to data submodule
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
f620f3589d
Adds length based batch sampler
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
8ac44ef3be
Fix vocab size mismatch in inference due to added pad token
|
%!s(int64=2) %!d(string=hai) anos |
|
Geeta Chauhan
|
40b32ba559
Fix tqdm bar not change length after terminal is resized (#201)
|
%!s(int64=2) %!d(string=hai) anos |
 hongbo.mo
|
6217635e87
Fix tqdm bar not change length after terminal is resized
|
%!s(int64=2) %!d(string=hai) anos |
|
Matthias Reso
|
0b2fa40dba
Add unit test for weight decay
|
%!s(int64=2) %!d(string=hai) anos |
 Shijie Wu
|
91e2573aa8
pass weight_decay into optimizer
|
%!s(int64=2) %!d(string=hai) anos |
 Hamid Shojanazeri
|
c38bf5bdd3
Add FSDP CPU offloading option (#122)
|
%!s(int64=2) %!d(string=hai) anos |
 Howard Liberty
|
cc356b6017
Add FSDP CPU offloading option
|
%!s(int64=2) %!d(string=hai) anos |
 Yuanhao
|
e554c1c8bf
The tokenizer will not add eos_token by default
|
%!s(int64=2) %!d(string=hai) anos |
 tim-a-davis
|
3038020aa4
Replaced ClassVar config param with field
|
%!s(int64=2) %!d(string=hai) anos |
|
Hamid Shojanazeri
|
cfacee4302
Update LLM_finetuning.md
|
%!s(int64=2) %!d(string=hai) anos |
