{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3cc12839-9c79-553d-b5de-07a2f2a75180","task_key":"default--test--7206","task_revision_id":"1","upstream_id":"7206","short_description":"What is the law of diminishing marginal utility?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['This principle suggests that as more units of a good are consumed, the total utility decreases.', 'The law asserts that the marginal utility of a good increases at a decreasing rate as consumption increases.', 'The law suggests that utility does not change with consumption and remains static over time.', 'It states that each additional unit of consumption yields greater utility than the previous one, indefinitely.', \\\"It's a rule that says the first unit of a good or service consumed yields the least utility.\\\", 'The Law of Diminishing Marginal Utility refers to the fact that as successive units are consumed, the utility derived from each additional unit decreases beyond some point.', 'It indicates that the utility derived from each additional unit consumed remains constant no matter how many units are consumed.', \\\"It's the principle that states that as the quantity of a good decreases, the utility derived from each additional unit increases.\\\", 'The law states that utility increases with each unit consumed.', 'The law claims that consumers derive equal utility from each additional unit consumed, regardless of the quantity already consumed.']\",\"question\":\"What is the law of diminishing marginal utility?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}