{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e91833ae-0b3f-5679-bb24-77ab8b865859","task_key":"default--test--7545","task_revision_id":"1","upstream_id":"7545","short_description":"What is the economic definition of labor?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Labor, in the economic sense, consists of all human abilities or talents which may be used in the production of goods and services.', 'Labor is the physical work done by people.', 'Labor is solely the work of factory workers and manual laborers.', 'Labor is the amount of effort put into a task.', 'Labor refers only to agricultural work and farming activities.', 'Labor is the management of resources in a company.', 'Labor is the machinery and equipment used in the production of goods.', 'Labor is the measure of time spent on leisure and recreational activities.', 'Labor is the capital used to start a business.', 'Labor is the process of hiring and managing employees in a business.']\",\"question\":\"What is the economic definition of labor?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}