{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7c8eac0-a5ff-5b10-852b-def6e8a8100c","task_key":"default--test--6997","task_revision_id":"1","upstream_id":"6997","short_description":"What is the importance of the so-called \"rule of 70\"?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Used for predicting market trends', 'A guideline for determining the sustainable withdrawal rate from a retirement account', 'A rule to determine retirement age based on savings and life expectancy', 'Used for calculating economic growth', 'A method for calculating the compound annual growth rate of an investment', 'Allows one to quickly calculate the number of years required for a doubling of the price level', 'Used for calculating annual rate of inflation', 'A budgeting rule where 70% of income is allocated to expenses, 20% to savings, and 10% to debt repayment', \\\"It's a financial principle for determining the interest rate needed for an investment to grow by 70%\\\"]\",\"question\":\"What is the importance of the so-called \\\"rule of 70\\\"?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}