{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2dd897d5-5784-5bcd-9eb3-9d6b12358169","task_key":"default--test--7082","task_revision_id":"1","upstream_id":"7082","short_description":"What do we mean when we say that the farm problem may be cor-rectly envisioned…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Overproduction and wastage of crops', 'Lack of alternative employment', 'Excessive government intervention in agriculture', 'Inefficient farming methods', 'Low income of farmers', 'High tariffs on agricultural imports', 'Fluctuations in global commodity prices', 'Suboptimal use of agricultural technology', 'Environmental degradation due to farming practices', 'A significant degree of resource misallocation']\",\"question\":\"What do we mean when we say that the farm problem may be cor-rectly envisioned as a problem of resource misallocation?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}