{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f70ef2ae-c138-558f-be64-20e1d21deb7d","task_key":"default--test--6947","task_revision_id":"1","upstream_id":"6947","short_description":"What does the Harrod-Domar model, taken with the Keynesian theory of savings,…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Rich and poor countries will experience the same growth rates regardless of savings rates', 'Poor countries will have fluctuating growth rates independent of savings', 'The level of technology determines growth rates, not savings', 'The level of income has no impact on savings', 'Savings have no correlation with growth rates in any country', 'Rich countries will have low growth rates', 'Poor countries will have high growth rates', 'High levels of savings will always lead to high growth rates', 'Poor countries will have low growth rates', 'Poor countries can achieve high growth rates regardless of investment levels']\",\"question\":\"What does the Harrod-Domar model, taken with the Keynesian theory of savings, imply for the growth rates of poor countries?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}