This website works better with JavaScript
Home
Explore
Help
Sign In
radu
/
LLamaRecipes
mirror of
https://github.com/facebookresearch/llama-recipes.git
Watch
1
Star
0
Fork
0
Files
Issues
0
Wiki
Browse Source
Update wordlist.txt
Hamid Shojanazeri
1 year ago
parent
c1be7d802a
commit
b49f31c300
1 changed files
with
5 additions
and
0 deletions
Split View
Show Diff Stats
5
0
scripts/spellcheck_conf/wordlist.txt
+ 5
- 0
scripts/spellcheck_conf/wordlist.txt
View File
@@ -1289,3 +1289,8 @@ tokenize
tokenizer's
tokenizers
warmup
+BOS
+EOS
+eot
+multiturn
+tiktoken