{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e96e4d6f-6cd9-5611-b9cd-a7695aee2b9a","task_key":"default--test--7596","task_revision_id":"1","upstream_id":"7596","short_description":"What is the saving schedule?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The saving schedule is a government-mandated plan for how citizens should allocate their earnings.', 'The saving schedule is a financial strategy that prioritizes investment opportunities over savings.', 'The saving schedule is an annual calendar marking national holidays when banks offer special saving rates.', 'The saving schedule is a method to calculate the amount of tax a household needs to pay.', 'The saving schedule is a timetable showing when a household needs to pay its bills.', 'The saving schedule is a record of past savings and expenditures used for auditing purposes.', 'The saving schedule is the relationship which shows how much of their incomes households plan to save for the various levels of disposable income.', \\\"The saving schedule is a breakdown of a household's recurring expenses and the expected dates of payment.\\\", \\\"The saving schedule is a bank's program outlining the interest rates for various saving accounts.\\\", 'The saving schedule is a list of all the things a household plans to buy.']\",\"question\":\"What is the saving schedule?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}