{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"147dabc8-e509-5bd9-a21b-98a86d10ca1a","task_key":"default--test--6948","task_revision_id":"1","upstream_id":"6948","short_description":"What, if any, are the differences between thenatureof demandfor land and, say,…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The demand for cars is usually for short-term use, whereas demand for land is for long-term investment', 'There are no differences between the demand for land and cars', 'Demand for land is primarily influenced by technological advancements, while demand for cars is not', 'The demand for land is a derived demand, it depends on the demand for final products which use land as a factor input', 'The demand for cars is infinite, whereas the demand for land is limited by its availability', 'The demand for land is exclusively for commercial use, while demand for cars is for personal use', 'Demand for cars is derived from the demand for land', 'Demand for land can only increase over time, whereas demand for cars can fluctuate more significantly', 'Land has no alternative uses, while cars can be used for multiple purposes', 'Demand for land is more stable than for cars']\",\"question\":\"What, if any, are the differences between thenatureof demandfor land and, say, the nature of demand for cars?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}