{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a8c4d58d-3e9d-5db2-afee-fd106f7eba53","task_key":"default--test--6844","task_revision_id":"1","upstream_id":"6844","short_description":"The purpose of \"augmenting\" the Dickey-Fuller test regression is to","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Ensure that there is no heteroscedasticity in the test regression residuals.', 'Improve the accuracy of the Dickey-Fuller test', 'Ensure that the test regression residuals are negatively skewed', 'Ensure that the test regression residuals are normally distributed', 'Ensure that all of the non-stationarity is taken into account.', 'Ensure that the test regression residuals have no outliers', 'Ensure that the test regression residuals are positively skewed', 'Ensure that there is no autocorrelation in the test regression residuals', 'Ensure that the test regression residuals are balanced', 'Increase the complexity of the Dickey-Fuller test']\",\"question\":\"The purpose of \\\"augmenting\\\" the Dickey-Fuller test regression is to\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}