Justin Lee e1d64ca2f4 update gitignore, added mmlu 0shot and ran a bunch of test 7 månader sedan
..
__init__.py e52e1d1ab4 updated prompt migration to use benchmark and also mipro, added meta implementation 8 månader sedan
datatypes.py e52e1d1ab4 updated prompt migration to use benchmark and also mipro, added meta implementation 8 månader sedan
download_mmlu_pro.py e1d64ca2f4 update gitignore, added mmlu 0shot and ran a bunch of test 7 månader sedan
helpers.py e1d64ca2f4 update gitignore, added mmlu 0shot and ran a bunch of test 7 månader sedan
humaneval.py 314b6a874a added updated llama-mmlu-pro and added human-eva 8 månader sedan
leaderboard_mmlu_pro.py e52e1d1ab4 updated prompt migration to use benchmark and also mipro, added meta implementation 8 månader sedan
llama_mmlu.py e1d64ca2f4 update gitignore, added mmlu 0shot and ran a bunch of test 7 månader sedan
llama_mmlu_pro.py dc406b4769 setup meta-eval for benchmark, ray error 7 månader sedan