{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32437e0c-d4e6-5870-9bbb-9be313939f07","task_key":"default--test--6917","task_revision_id":"1","upstream_id":"6917","short_description":"If OLS is applied separately to each equation that is part of a simultaneous…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Biased, inconsistent, and inefficient.', 'Biased but consistent', 'Unbiased and consistent', 'Biased but inconsistent for one equation only', 'Unbiased and efficient', 'Unbiased but inconsistent', 'It is impossible to apply OLS to equations that are part of a simultaneous system', 'Consistent but inefficient', 'It is possible to apply OLS to equations that are part of a simultaneous system, but the results will be unpredictable', 'Biased and inconsistent']\",\"question\":\"If OLS is applied separately to each equation that is part of a simultaneous system, the resulting estimates will be\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}