{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"facf46a6-4154-5c46-a061-af71466094b1","task_key":"default--test--7577","task_revision_id":"1","upstream_id":"7577","short_description":"Which of the following might explain how a price decrease might cause a decrease…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The good is inferior and a luxury.', 'The good is inferior and the income effect is stronger than the substitution effect.', 'The good is a luxury and the income effect is stronger than the substitution effect.', 'The good is inferior and a necessity.', 'The good is normal and a luxury.', 'The good is normal and the income effect is weaker than the substitution effect.', 'The good is a luxury and the income effect is weaker than the substitution effect.', 'The good is normal and the income effect is stronger than the substitution effect.', 'The good is inferior and the income effect is weaker than the substitution effect.', 'The good is a necessity and the income effect is stronger than the substitution effect.']\",\"question\":\"Which of the following might explain how a price decrease might cause a decrease in quantity demanded and an upward-sloping demand curve?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}