{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1bf05be6-1e8b-5765-86df-1a562a5f4f54","task_key":"default--test--7329","task_revision_id":"1","upstream_id":"7329","short_description":"What is the principle of diminishing marginal returns?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['A rule that describes how, after a certain level of performance, additional input does not yield any output', 'A point beyond which the output attributable to each additional unit of factor input will become less and less.', 'An economic principle that suggests a constant decrease in output with each additional input', 'An economic theory that predicts unlimited growth', 'The phenomenon where output increases exponentially with each additional input', 'The principle stating that output increases linearly with input', 'The idea that each unit of input improves the quality of output, regardless of how much is already being produced', 'The concept that each additional input doubles the output', 'The belief that each additional unit of input decreases the total cost of production', 'A process where increasing amounts of input lead to proportional increases in output']\",\"question\":\"What is the principle of diminishing marginal returns?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}