{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45367008-cc4f-5878-b1f6-4773055d774d","task_key":"default--test--7752","task_revision_id":"1","upstream_id":"7752","short_description":"Alex needs to borrow $\\$10,\\!000$ from the bank. The bank gives him two options.…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['381', '383', '384', '382', '385', '16398', '16399', '380', '16400', '16401']\",\"question\":\"Alex needs to borrow $\\\\$10,\\\\!000$ from the bank. The bank gives him two options. 1. A ten-year loan with an annual interest rate of $10\\\\%$ compounded quarterly, with the condition that at the end of 5 years, Alex must make a payment equal to half of what he owes. The other half continues to accrue interest, and at the end of the ten years, Alex will pay off the remaining balance. 2. A ten-year loan with a simple annual interest rate of $12\\\\%$, with just one lump-sum payment at the end of the ten years. Find the positive difference between the total amounts Alex has to pay back under the two schemes. Round your answer to the nearest dollar.\",\"src\":\"ori_mmlu-high_school_mathematics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}