add MMLU benchmark val / test - #1

Merged

LZHgrla merged 11 commits into

InternLM:mainfrom

LZHgrla:lzh/add_mmlu

Jul 14, 2023

Commits on Jul 12, 2023

add mmlu dataset configs
LZHgrla
committed
cc5a8ad
add mmlu metric
LZHgrla
committed
d20bc9d
fix bugs
LZHgrla
committed
1a5e29e
implement predict for sft model
LZHgrla
committed
1543518
remove dummy file
LZHgrla
committed
3ddcd62
clean code
LZHgrla
committed
8c5eb18

Commits on Jul 13, 2023

modify prefix for mmlu test
LZHgrla
committed
5b8447e
add test.py
LZHgrla
committed
d7ae93b
add mmlu val/test for gunaco config
LZHgrla
committed
1c37dbd
use float16 for gunaco
LZHgrla
committed
4338c9b
add METAINFO and add logger
LZHgrla
committed
2ef387e