{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df019c1c-9e76-5ef4-9498-85b33f0757a2","task_key":"default--test--6585","task_revision_id":"1","upstream_id":"6585","short_description":"Which statement about Engel's law on food economics is correct?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['As income declines, the proportion of income spent on food, increases', 'As income remains the same, the proportion of income spent on food, increases', 'As income rises, the proportion of income spent on food, remains similar', 'As income remains the same, the proportion of income spent on food, declines', 'As income declines, the proportion of income spent on non-food items, increases', 'As income declines, the proportion of income spent on food, declines', 'As income declines, the proportion of income spent on food, remains similar', 'As income rises, the proportion of income spent on food, increases', 'As income rises, the proportion of income spent on non-food items, declines', 'As income rises, the proportion of income spent on food, declines']\",\"question\":\"Which statement about Engel's law on food economics is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}