{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"af4ed868-81e3-540a-8f18-fbe7e0290356","task_key":"default--test--6848","task_revision_id":"1","upstream_id":"6848","short_description":"Distinguish between the transfer earnings of a piece of land andeconomic rent on…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Transfer earnings and economic rent are the same', 'Transfer earnings are the price of land, while economic rent is the cost of using the land', 'Transfer earnings are what the land would earn in its best alternative use, while economic rent is anything paid over and above the transfer earnings.', 'Transfer earnings are the cost of land, economic rent is the revenue from land']\",\"question\":\"Distinguish between the transfer earnings of a piece of land andeconomic rent on a piece of land.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}