{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"538d02e5-cd45-52b8-9e80-767175e0b4dc","task_key":"default--test--7008","task_revision_id":"1","upstream_id":"7008","short_description":"What are some reasons why there has been a relativeshift fromfarming?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The invention of automated systems that have made traditional farming obsolete', 'Emergence of widespread diseases that make farming untenable', 'Shift in consumer preferences towards synthetic foods', 'A global decrease in the demand for agricultural products', 'People seek the higher incomes of the city, shorter hours, and better social life in town', 'Government policies against farming', 'The depletion of essential non-renewable farming resources']\",\"question\":\"What are some reasons why there has been a relativeshift fromfarming?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}