 Hamid Shojanazeri
|
df03fd4b12
Recipe to add a new language to Llama2 (#429)
|
1 vuosi sitten |
 Rahul A R
|
cc1029bcf1
update wordlist.txt
|
1 vuosi sitten |
|
Rahul A R
|
664429b726
Merge branch 'main' of github.com:rahul-sarvam/llama-recipes
|
1 vuosi sitten |
|
Rahul A R
|
e98f6de80d
typo
|
1 vuosi sitten |
 Kai Wu
|
03f1ca7817
fixed some typo to pass spellcheck
|
1 vuosi sitten |
 Matthias Reso
|
83fae41195
Add test for chat completion formatting
|
1 vuosi sitten |
|
Kai Wu
|
d0b7a20c89
finetuning readme updated
|
1 vuosi sitten |
|
Hamid Shojanazeri
|
e3d750f49f
Update wordlist.txt
|
1 vuosi sitten |
|
Rahul A R
|
09028bf893
addressing Hamid's comments
|
1 vuosi sitten |
|
Matthias Reso
|
6d9d48d619
Use apply_chat_template instead of custom functions
|
1 vuosi sitten |
|
Matthias Reso
|
5efea160a2
Adapt test_finetuning to new model
|
1 vuosi sitten |
 rahul-sarvam
|
eb7ef4225f
Update recipes/multilingual/README.md
|
1 vuosi sitten |
|
rahul-sarvam
|
f1f335a591
Update recipes/multilingual/README.md
|
1 vuosi sitten |
|
rahul-sarvam
|
47556ce0a6
Update recipes/multilingual/README.md
|
1 vuosi sitten |
|
Matthias Reso
|
739483f262
Adjust test_grammar_datasets to stable sort
|
1 vuosi sitten |
|
Matthias Reso
|
b96e435cda
Adjust test_samsum_dataset to second model
|
1 vuosi sitten |
|
Matthias Reso
|
fac41298b0
Adapt test_custom_dataset to new model
|
1 vuosi sitten |
|
Matthias Reso
|
960014a3bb
Fix test_custom_dataset by introducing a stable sort algorithm
|
1 vuosi sitten |
|
Matthias Reso
|
b5583b31d5
Adapt test_grammar_dataset to new model
|
1 vuosi sitten |
|
Matthias Reso
|
17a6d16289
Test batching for both llama versions
|
1 vuosi sitten |
|
Kai Wu
|
7b1a9413d2
fixed a typo
|
1 vuosi sitten |
|
Kai Wu
|
41434dc825
formatted and removed duplicated or unused function get_total_flops() and byte2mb()
|
1 vuosi sitten |
|
Kai Wu
|
f2e80bae22
created a FlopMeasure class on top of FlopCounterMode instead of keep of copy of our own tflop_counter.py
|
1 vuosi sitten |
|
Matthias Reso
|
a414ca6a57
Update chat format for llama3
|
1 vuosi sitten |
|
Kai Wu
|
69e46887b4
handling incorrect profiling early stop caused by max_train_steps and add profiler.step() for each train step
|
1 vuosi sitten |
|
Matthias Reso
|
113ea18bf1
Replace LlamaTokenizer with AutoTokenizer
|
1 vuosi sitten |
 Beto
|
5979dbe996
Merging local with remote
|
1 vuosi sitten |
|
Kai Wu
|
34e0bf4c6e
second draft of this feature, seems to be working now
|
1 vuosi sitten |
|
Beto
|
d4cbfa1cc1
Merging upstream llama-recipes to current repo
|
1 vuosi sitten |
|
Kai Wu
|
a35519ee90
fixed typo and handling unexpected exit
|
1 vuosi sitten |
