{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d24c6fe0-9464-53b8-8590-24b7e6edd99c","task_key":"default--test--7138","task_revision_id":"1","upstream_id":"7138","short_description":"The classical economists emphasized cost of production as the determinant of…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Marshall disregarded the importance of time', 'Marshall argued that production technology is the sole determinant of price.', 'Marshall suggested that prices fluctuate based solely on market speculation.', 'Marshall synthesized the views of earlier writers into a new theory of price.', 'Marshall introduced the concept of supply', 'Marshall solely focused on demand', 'Marshall proposed that prices are set by a central authority.', 'Marshall established that prices are fixed and do not change over time.', 'Marshall claimed that price is determined by government regulations.', 'Marshall introduced the idea that only consumer preferences determine price.']\",\"question\":\"The classical economists emphasized cost of production as the determinant of price. The earlymarginaliststhought that demand determined price. What was AlfredMarshall's contribution to this debate?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}