Matthias Reso 6d9d48d619 Use apply_chat_template instead of custom functions 1 rok pred
..
configs fa0a389f74 add max_step feature for training and eval 1 rok pred
data 960014a3bb Fix test_custom_dataset by introducing a stable sort algorithm 1 rok pred
datasets 69db75d425 fix incorrect split of InstructionDataset 1 rok pred
inference 6d9d48d619 Use apply_chat_template instead of custom functions 1 rok pred
model_checkpointing ce9501f22c remove relative imports 2 rokov pred
policies ce9501f22c remove relative imports 2 rokov pred
tools 4913d3ad24 Add missing copyright header 1 rok pred
utils 17a6d16289 Test batching for both llama versions 1 rok pred
finetuning.py 113ea18bf1 Replace LlamaTokenizer with AutoTokenizer 1 rok pred