{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef24e00d-1f89-572c-8a41-919209ca8a24","task_key":"default--test--6918","task_revision_id":"1","upstream_id":"6918","short_description":"What is meant by `consumer sovereignty'?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Consumer sovereignty refers to the role of consumers in determining the types and quantities of goods produced.', 'Consumer sovereignty refers to the role of governments in regulating the types and quantities of goods produced.', 'Consumer sovereignty refers to the idea that manufacturers can predict and set consumer preferences without market feedback.', 'Consumer sovereignty refers to the role of market competition in determining the types and quantities of goods produced.', 'Consumer sovereignty refers to the dominance of a single consumer in dictating the market trends.', 'Consumer sovereignty refers to the economic principle where the government has the ultimate control over the market.', 'Consumer sovereignty refers to the power of retailers to influence the types and quantities of goods produced.', 'Consumer sovereignty refers to a theoretical state where all consumers have an equal say in the production decisions of all companies.', 'Consumer sovereignty refers to the role of producers in determining the types and quantities of goods produced.', 'Consumer sovereignty refers to the ability of consumers to enact legislation regarding the production of goods.']\",\"question\":\"What is meant by `consumer sovereignty'?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}