{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2defa2d1-2942-533c-a345-7b595466bf1b","task_key":"default--test--7126","task_revision_id":"1","upstream_id":"7126","short_description":"Which of the following could result in autocorrelated residuals?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(i), (iii), and (iv) only', '(i) and (iv) only', '(i) and (ii) only', '(ii) and (iv) only', '(i) and (iii) only', '(iii) and (iv) only', '(ii), (iii), and (iv) only', '(ii) and (iii) only', '(i), (ii), (iii), and (iv)', '(i), (ii), and (iii) only']\",\"question\":\"Which of the following could result in autocorrelated residuals?\\n\\ni) Slowness of response of the dependent variable to changes in the values of the independent variables\\n\\nii) Over-reactions of the dependent variable to changes in the independent variables\\n\\niii) Omission of relevant explanatory variables that are autocorrelated\\n\\niv) Outliers in the data\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}