Commit History

Author SHA1 Message Date
  Matthias Reso 10f9367e56 fix missing labels in datasets 2 years ago
  Matthias Reso ca41c1c697 Adjust tests to len based batch sampling 2 years ago
  Matthias Reso ec00a2f722 Fix batching error 2 years ago
  Matthias Reso dc507b4e55 Finish implementation oasst preprocessing for of custom dataset 2 years ago
  Matthias Reso 32cf7ad459 [WIP] Preprocess oasst dataset 2 years ago
  Matthias Reso ba1c789c51 Rename custom dataset function to comply with documentation 2 years ago
  Matthias Reso 33c7738dcc Added mechanism to supply a custom dataset without changing source files 2 years ago