{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7203cc1-27a6-5088-8e8e-6d60f2f44416","task_key":"default--test--6946","task_revision_id":"1","upstream_id":"6946","short_description":"Distinguish economic goods from free goods, and give an example of each.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Economic goods require large amounts of resources to produce, such as diamonds, while free goods are created with minimal resources, like sunlight.', 'Economic goods are non-renewable resources, like coal. Free goods regenerate naturally and have no cost, like wind energy.', 'Economic goods are plentiful and satisfy all wants, like air. Free goods are scarce and command a positive price, like oil.', 'Economic goods and free goods are the same, both are available in sufficient quantity to satisfy all wants.', 'Economic goods are produced by the government and are free of charge, like public education. Free goods are produced by private companies and have high prices, like smartphones.', 'Economic goods are those that cannot be consumed by multiple people at once, like a sandwich. Free goods can be shared by many simultaneously, like a public park.', 'Economic goods are free, like air. Free goods are costly and scarce, like oil.', 'Economic goods are scarce and command a positive price, like oil. Free goods are plentiful and satisfy all wants, like air.', 'Economic goods are services that come at a cost, like legal advice. Free goods are natural phenomena that are not owned, like moonlight.', 'Economic goods are items with no intrinsic value, like currency. Free goods are essential for survival and cannot be owned, like oxygen.']\",\"question\":\"Distinguish economic goods from free goods, and give an example of each.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}