{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f72a6574-3f1e-5d8f-ab92-505f3bd93bef","task_key":"default--test--6880","task_revision_id":"1","upstream_id":"6880","short_description":"If the capital/output ratio is 2.5, and GNP rises from $985 billionto $1,055…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['$100 billion and $200 billion', '$200 billion and $400 billion', '$150 billion and $300 billion', '$175 billion and $350 billion', '$160 billion and $320 billion', '$140 billion and $280 billion', '$125 billion and $250 billion', '$220 billion and $440 billion', '$130 billion and $260 billion', '$190 billion and $380 billion']\",\"question\":\"If the capital/output ratio is 2.5, and GNP rises from $985 billionto $1,055 billion, by how much can investment be expectedto increase, assuming no depreciation? Also, if themarginal propensity to consume is 0.5, what will be the extrachanges in GNP induced by the original rise?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}