{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"394a0a2d-388b-54ab-80a6-e096acea4875","task_key":"default--test--711","task_revision_id":"1","upstream_id":"711","short_description":"Joanna Moorman borrowed $2,000 from the credit union where she works, agreeing…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['87 days, $43.50, $2043.50', '88 days, $48, $2048', '91 days, $50, $2050', '90 days, $45, $2045', '92 days, $46, $2046', '92 days, $49, $2049', '89 days, $44.50, $2044.50', '89 days, $40, $2040', '93 days, $42, $2042', '95 days, $47.50, $2047.50']\",\"question\":\"Joanna Moorman borrowed $2,000 from the credit union where she works, agreeing to pay 9% interest for the actual number of days during which the loan was outstanding. The date on which the money was borrowed was April 12, and the full amount, including interest, was paid on July 11. a. For how many days will Mrs. Moorman pay interest? b. What is the amount of interest to be paid? c. What is the total amount due the credit union?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}