{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4af748c-8a61-56c4-806a-3bdb93d67b80","task_key":"default--test--540","task_revision_id":"1","upstream_id":"540","short_description":"The Harbor Lights Boat Company loaned an employee $3,000 to help toward the down…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['60 days, $45.63, $3,045.63', '44 days, $33.12, $3,033.12', '50 days, $47.50, $3,047.50', '46 days, $34.59, $3,034.59', '35 days, $26.56, $3,026.56', '45 days, $35.63, $3,035.63', '30 days, $28.75, $3,028.75', '45 days, $42.19, $3,042.19', '45 days, $40.63, $3,040.63', '30 days, $25.63, $3,025.63']\",\"question\":\"The Harbor Lights Boat Company loaned an employee $3,000 to help toward the down payment on a new house. The employee agreed to pay 9(1 / 2) % interest for the number of days he owed the money. The date of the loan was September 16, and it was repaid on October 31 of the same year. a. How many days' interest will the company charge the employee? b. What is the amount of interest the company will collect? c. What is the total amount the company received from the employee on October 31?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}