Matthias Reso 6d9d48d619 Use apply_chat_template instead of custom functions 2 years ago
..
configs fa0a389f74 add max_step feature for training and eval 2 years ago
data 960014a3bb Fix test_custom_dataset by introducing a stable sort algorithm 2 years ago
datasets 69db75d425 fix incorrect split of InstructionDataset 2 years ago
inference 6d9d48d619 Use apply_chat_template instead of custom functions 2 years ago
model_checkpointing ce9501f22c remove relative imports 2 years ago
policies ce9501f22c remove relative imports 2 years ago
tools 4913d3ad24 Add missing copyright header 2 years ago
utils 17a6d16289 Test batching for both llama versions 2 years ago
finetuning.py 113ea18bf1 Replace LlamaTokenizer with AutoTokenizer 2 years ago