{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4934d089-a43a-5fdc-8a09-df19361a9ecd","task_key":"default--test--7309","task_revision_id":"1","upstream_id":"7309","short_description":"Including relevant lagged values of the dependent variable on the right hand…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Biased, inconsistent and inefficient coefficient estimates', 'Unbiased and inconsistent but efficient coefficient estimates', 'Biased and inconsistent coefficient estimates', 'Biased but inconsistent but efficient coefficient estimates', 'Unbiased, consistent and efficient coefficient estimates', 'Unbiased and consistent but efficient coefficient estimates', 'Unbiased and consistent but inefficient coefficient estimates.', 'Unbiased but inconsistent coefficient estimates', 'Biased and consistent but inefficient coefficient estimates', 'Biased but consistent coefficient estimates']\",\"question\":\"Including relevant lagged values of the dependent variable on the right hand side of a regression equation could lead to which one of the following?\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}