{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"38861083-e532-51b8-8b87-94d682f1c134","task_key":"default--test--7257","task_revision_id":"1","upstream_id":"7257","short_description":"Economics supposedly deals with the efficient allocation of scarce goods. Where…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Scarcity is relevant only for non-renewable resources in the circular flow model', 'Scarcity is only relevant in the factor markets of the circular flow model', 'Scarcity is only considered in the household sector of the circular flow model', 'Scarcity is addressed through government intervention in the circular flow model', 'Scarcity is implicit in the entire analysis of the circular flow model', 'Scarcity is only relevant in the business sector of the circular flow model', 'Scarcity is not relevant in the circular flow model', 'Scarcity is only relevant in the product markets of the circular flow model', 'Scarcity is a concept that is added to the circular flow model in a separate diagram', 'Scarcity is dealt with by the foreign sector in the circular flow model']\",\"question\":\"Economics supposedly deals with the efficient allocation of scarce goods. Where does scarcity fit in the circular flow model?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}