Holistic Evaluation of Language Models (HELM)
Percy Liang, Rishi Bommasani, Tony Lee, et al., Transactions on Machine Learning Research, 2022
Evaluates many language models across a broad set of scenarios and several metrics at once — including calibration, robustness, fairness, bias and toxicity — rather than accuracy alone.