{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25802397-666f-5bc5-ad14-038da50918b7","task_key":"default--test--7300","task_revision_id":"1","upstream_id":"7300","short_description":"When a good is taxed, the tax burden falls mainly on the consumer if","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['both demand and supply are perfectly elastic', 'the demand is elastic and the supply is inelastic', 'the demand is elastic and the supply is elastic', 'the demand is perfectly elastic and the supply is inelastic', 'the demand is unitary elastic and the supply is elastic', 'both demand and supply are perfectly inelastic', 'the demand is inelastic and the supply is elastic', 'the demand is inelastic and the supply is inelastic', 'the demand is perfectly inelastic and the supply is perfectly elastic', 'the demand is elastic and the supply is unitary elastic']\",\"question\":\"When a good is taxed, the tax burden falls mainly on the consumer if\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}