{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"48b546b2-dc07-58f9-852b-b64b8039c47c","task_key":"default--test--6879","task_revision_id":"1","upstream_id":"6879","short_description":"What is opportunity cost? W","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Opportunity cost is the time required to produce a good or service', 'Opportunity cost is the financial cost of production', 'Opportunity cost is the revenue generated from the sale of a good or service', 'Opportunity cost is the direct monetary cost associated with the purchasing of a good or service', 'Opportunity cost is the benefit that is lost when an investor chooses one alternative over another', 'Opportunity cost is the sum of all costs involved in making a decision', 'Opportunity cost is the sacrifice of a good or service that might have been produced instead when resources are used for a particular good or service.', 'Opportunity cost is the benefit gained from the next best alternative', 'Opportunity cost is the total cost of production', 'Opportunity cost is the cost of not choosing the second-best option available']\",\"question\":\"What is opportunity cost? W\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}