{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4ca5da0-5d13-58d7-ae07-c35d29b8d577","task_key":"default--test--5473","task_revision_id":"1","upstream_id":"5473","short_description":"Which of the following is the proper treatment of the cost of equipment used in…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Capitalized and depreciated over the term of the research and development project.', \\\"Expensed as incurred, regardless of the project's term or future use.\\\", 'Capitalized and depreciated over its estimated useful life.', 'Expensed in the year in which the research and development project started.', 'Either capitalized or expensed, but not both, depending on the term of the research and development project.', 'Capitalized but not depreciated.', 'Capitalized and depreciated over the estimated useful life of the research and development project, unless the equipment has no alternative future uses.', 'Either capitalized or expensed, depending on the potential success of the research and development project.', 'Expensed in the year in which the research and development project is completed.']\",\"question\":\"Which of the following is the proper treatment of the cost of equipment used in research and development activities that will have alternative future uses?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}