 Justin Lee
|
e1d64ca2f4
update gitignore, added mmlu 0shot and ran a bunch of test
|
hace 7 meses |
|
Justin Lee
|
dc406b4769
setup meta-eval for benchmark, ray error
|
hace 7 meses |
|
Justin Lee
|
9ffb292272
added inspect and modified harness
|
hace 7 meses |
|
Justin Lee
|
eea96618cf
batching and parallelization, ran on baseline and lite
|
hace 7 meses |
|
Justin Lee
|
becbe77ff3
attempt to fix json output format in eval
|
hace 7 meses |
|
Justin Lee
|
2776a35314
harness runcode
|
hace 8 meses |
|
Justin Lee
|
62b53676fb
update harness notebook
|
hace 8 meses |
|
Justin Lee
|
e52e1d1ab4
updated prompt migration to use benchmark and also mipro, added meta implementation
|
hace 8 meses |
