Holistic Evaluation of Language Models (HELM)

Percy Liang, Rishi Bommasani, Tony Lee, et al., Transactions on Machine Learning Research, 2022

Evaluates many language models across a broad set of scenarios and several metrics at once — including calibration, robustness, fairness, bias and toxicity — rather than accuracy alone.

BenchmarkIntermediateAbout 3 hours