{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3370f91-1602-58db-94fc-a2e3de311a2f","task_key":"default--test--5415","task_revision_id":"1","upstream_id":"5415","short_description":"Bale Co. incurred $100,000 of acquisition costs related to the purchase of the…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Treated as a separate asset and depreciated over its useful life', 'Capitalized as part of goodwill and tested annually for impairment', 'Capitalized as part of the cost of investment and tested annually for impairment', 'Expensed as incurred in the subsequent period', 'Allocated on a pro rata basis to the monetary assets acquired.', 'Capitalized as part of inventory and expensed as incurred', 'Capitalized as an other asset and amortized over five years.', 'Expensed over the next five years', 'Expensed as incurred in the current period', 'Allocated on a pro rata basis to the nonmonetary assets acquired.']\",\"question\":\"Bale Co. incurred $100,000 of acquisition costs related to the purchase of the net assets of Dixon Co. The $100,000 should be\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}