{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7b05da4-10f0-51b0-84f1-33a1bd7e0c88","task_key":"default--test--7365","task_revision_id":"1","upstream_id":"7365","short_description":"Which of the following examples would result in consumers paying for the largest…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['If both the demand and supply curves are price inelastic', 'If the demand curve is perfectly elastic and the supply curve is perfectly inelastic', 'If the demand curve is price inelastic and the supply curve is price elastic', 'If both the demand and supply curves are price elastic', 'If the demand curve is price elastic and the supply curve is price inelastic', 'If the demand curve is perfectly inelastic and the supply curve is price elastic', 'If the demand curve is perfectly inelastic and the supply curve is perfectly elastic', 'If the demand curve is perfectly elastic and the supply curve is price inelastic', 'If the demand curve is price elastic and the supply curve is perfectly elastic', 'If the demand curve is price inelastic and the supply curve is perfectly inelastic']\",\"question\":\"Which of the following examples would result in consumers paying for the largest burden of an excise tax placed on a producer?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}