Justin Lee e1d64ca2f4 update gitignore, added mmlu 0shot and ran a bunch of test 9 månader sedan
..
__init__.py e52e1d1ab4 updated prompt migration to use benchmark and also mipro, added meta implementation 10 månader sedan
datatypes.py e52e1d1ab4 updated prompt migration to use benchmark and also mipro, added meta implementation 10 månader sedan
download_mmlu_pro.py e1d64ca2f4 update gitignore, added mmlu 0shot and ran a bunch of test 9 månader sedan
helpers.py e1d64ca2f4 update gitignore, added mmlu 0shot and ran a bunch of test 9 månader sedan
humaneval.py 314b6a874a added updated llama-mmlu-pro and added human-eva 9 månader sedan
leaderboard_mmlu_pro.py e52e1d1ab4 updated prompt migration to use benchmark and also mipro, added meta implementation 10 månader sedan
llama_mmlu.py e1d64ca2f4 update gitignore, added mmlu 0shot and ran a bunch of test 9 månader sedan
llama_mmlu_pro.py dc406b4769 setup meta-eval for benchmark, ray error 9 månader sedan