{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a964cf99-c231-5dcc-8b98-d7494b0006ac","task_key":"default--test--6882","task_revision_id":"1","upstream_id":"6882","short_description":"What is the economic definition of \\textquotedblleftland\\textquotedblright?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Land includes only renewable resources such as wind and solar energy', 'Land is the categorization for all man-made infrastructure', 'Land is any space that can be occupied by a building', \\\"Land is defined as the physical space directly above and below the earth's surface, excluding any natural resources\\\", 'Land is the collective term for all financial assets and investments', 'Land is any resource that is not labor or capital', 'Land represents only the agricultural soil used for crop production', 'Land refers only to the surface of the Earth', 'Land encompasses exclusively urban areas designated for construction and development', 'Land, as defined in economics, includes all natural resources found on or within the earth, sea or air, which can be used in the productive process.']\",\"question\":\"What is the economic definition of \\\\textquotedblleftland\\\\textquotedblright?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}