{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4e21b45-345f-5ced-b461-f8976359e1c3","task_key":"default--test--6932","task_revision_id":"1","upstream_id":"6932","short_description":"Define income inequality.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Income Inequality refers to the variations in educational attainment among different demographics', 'Income Inequality is about how much money one makes', 'Income Inequality is the measure of how taxes are distributed across different income groups', 'Income Inequality is the difference between the rich and the poor', 'Income Inequality is the gap in employment rates between various social groups', 'Income Inequality means equal pay for equal work across all sectors', 'Income Inequality refers to the unfair distribution of wealth', 'Income Inequality is the disparity in access to healthcare services between the rich and the poor', 'Income Inequality exists in distribution of income and wealth ownership', 'Income Inequality is the difference in living standards across different countries']\",\"question\":\"Define income inequality.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}