Matthias Reso 6d9d48d619 Use apply_chat_template instead of custom functions 1 year ago
..
configs fa0a389f74 add max_step feature for training and eval 1 year ago
data 960014a3bb Fix test_custom_dataset by introducing a stable sort algorithm 1 year ago
datasets 69db75d425 fix incorrect split of InstructionDataset 1 year ago
inference 6d9d48d619 Use apply_chat_template instead of custom functions 1 year ago
model_checkpointing ce9501f22c remove relative imports 2 years ago
policies ce9501f22c remove relative imports 2 years ago
tools 4913d3ad24 Add missing copyright header 1 year ago
utils 17a6d16289 Test batching for both llama versions 1 year ago
finetuning.py 113ea18bf1 Replace LlamaTokenizer with AutoTokenizer 1 year ago