{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a7b4e8f-2765-5156-be40-c5d7fcec3ce6","task_key":"default--test--7447","task_revision_id":"1","upstream_id":"7447","short_description":"If OLS is used in the presence of autocorrelation, which of the following will…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(iii) and (iv) only', '(i), (ii), and (iii) only', '(i) and (iii) only', '(ii), (iii), and (iv) only', '(i), (ii), (iii), and (iv)', '(i) and (iv) only', '(i), (iii), and (iv) only', '(i) and (ii) only', '(ii) and (iii) only', '(ii) and (iv) only']\",\"question\":\"If OLS is used in the presence of autocorrelation, which of the following will be likely consequences?\\n\\ni) Coefficient estimates may be misleading\\n\\n\\nii) Hypothesis tests could reach the wrong conclusions\\n\\n\\niii) Forecasts made from the model could be biased\\n\\n\\niv) Standard errors may inappropriate\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}