 Kevin Slagle
|
52a85e1564
merge
|
il y a 1 an |
 Hamid Shojanazeri
|
808a3f7a0c
Adding support for FSDP+Qlora. (#572)
|
il y a 1 an |
 Kai Wu
|
480c4f2b5e
resume the finetuning given the path of the previous peft checkpoint folder
|
il y a 1 an |
|
Kevin Slagle
|
2f7001ef73
document less obvious training config parameters
|
il y a 1 an |
 Matthias Reso
|
091d58df17
Disable prefix tuning as its currently not supported; Limit llama_adapter usage to non-FSDP only
|
il y a 1 an |
|
Kai Wu
|
26e877fd42
changed readme, unified the context interface and added get_flops_per_sec()
|
il y a 1 an |
|
Kai Wu
|
fe51935fa6
Merge branch 'main' into feature/flop_counter
|
il y a 1 an |
|
Hamid Shojanazeri
|
df03fd4b12
Recipe to add a new language to Llama2 (#429)
|
il y a 1 an |
|
Kai Wu
|
03f1ca7817
fixed some typo to pass spellcheck
|
il y a 1 an |
|
Kai Wu
|
a35519ee90
fixed typo and handling unexpected exit
|
il y a 1 an |
 Rahul A R
|
2fa8e69b62
add new argument: tokenizer_name
|
il y a 1 an |
|
Kai Wu
|
fa0a389f74
add max_step feature for training and eval
|
il y a 1 an |
|
Hamid Shojanazeri
|
ffdc93f00a
Merge branch 'main' into wandb_logging
|
il y a 1 an |
|
Hamid Shojanazeri
|
162be4c045
Revert "Flop counter, profiling and GC (#357)"
|
il y a 1 an |
|
Hamid Shojanazeri
|
71d137c722
Merge branch 'main' into flop_counter_gc
|
il y a 1 an |
 Beto
|
7474514fe0
Merging with main
|
il y a 1 an |
 kldarek
|
989b6ee812
wandb logging feedback
|
il y a 1 an |
 gaopengzhi
|
e2797abe9b
Add gradient_clipping and gradient_clipping_threshold parameters
|
il y a 1 an |
|
kldarek
|
cf373529f7
basic wandb logging instrumentation
|
il y a 2 ans |
|
Beto
|
17d02c3b44
Adding config to conditionally save stats
|
il y a 2 ans |
|
gaopengzhi
|
04befdef69
Add gradient clipping feature
|
il y a 2 ans |
|
Matthias Reso
|
a647955fc8
Make packing/padding a training setting
|
il y a 2 ans |
|
Hamid Shojanazeri
|
35b394e49f
adding profiler and flop_counter
|
il y a 2 ans |
|
Hamid Shojanazeri
|
d56d5c469d
adding flop counter
|
il y a 2 ans |
|
Matthias Reso
|
72a9832571
Merge branch 'main' into feature/package_distribution
|
il y a 2 ans |
|
Matthias Reso
|
cf678b9bf0
Adjust imports to package structure + cleaned up imports
|
il y a 2 ans |
|
Matthias Reso
|
4c9cc7d223
Move modules into separate src folder
|
il y a 2 ans |
