Kai Wu ce299b3439 add get_custom_data_collator feature 7 months ago
..
grammar_dataset e8bb7fbabc Merge remote-tracking branch 'origin/main' into feature/length_based_batch_sampling 1 year ago
__init__.py ce299b3439 add get_custom_data_collator feature 7 months ago
alpaca_dataset.py 41a46d811d fix alpaca dataset by using 5% of the data as eval and make sure len((eval_loader)>0 10 months ago
custom_dataset.py ce299b3439 add get_custom_data_collator feature 7 months ago
samsum_dataset.py 48ba6805af Enable users to trust remote code in samsum dataset (#628) 8 months ago
toxicchat_dataset.py 2668bf4c35 Address feedback not possible before launch in LG3 recipe and dataset file (#606) 9 months ago