 Matthias Reso
|
9def4fbafd
Remove micro_batch_training parameter and replace with gradient_accumulation_steps
|
2 vuotta sitten |
 Brian Vaughan
|
3faf005226
fix a bug in the config for use_fast_kernels
|
2 vuotta sitten |
 lchu
|
feaa344af3
resolve conflicts
|
2 vuotta sitten |
 Hamid Shojanazeri
|
44ef280d31
adding flash attention and xformer memory efficient through PT SDPA
|
2 vuotta sitten |
|
lchu
|
895dfcea30
add nightly check for using low_cpu_fsdp mode
|
2 vuotta sitten |
 chauhang
|
4767f09ecd
Initial commit
|
2 vuotta sitten |
