{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0851dd43-68b8-5024-8a14-70773342e1be","task_key":"default--test--7413","task_revision_id":"1","upstream_id":"7413","short_description":"What is the economic definition of \\textquotedblleftlabor\\textquotedblright ?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Activities related to hiring and managing employees only', 'The capital invested in businesses for production purposes', 'The use of machinery and technology exclusively in producing goods or services', 'Only physical work', 'Only mental work', 'All human abilities or talents used in the production of goods or services.', 'The process of developing and executing business strategies without direct human involvement', 'Work by entrepreneurs only', 'The exchange of services between businesses without involving human effort', 'The natural resources exploited for production']\",\"question\":\"What is the economic definition of \\\\textquotedblleftlabor\\\\textquotedblright ?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}