{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4edca8d9-356d-5ee2-ada8-9ea829c750a7","task_key":"default--test--610","task_revision_id":"1","upstream_id":"610","short_description":"Describe a procedure that can be used to determine inventory turnover rate.","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Divide the total inventory by the cost of goods sold at the end of the period', 'Add the beginning inventory to the cost of goods sold, then divide by the ending inventory', 'Add the cost of goods sold to the ending inventory, then divide by the beginning inventory', 'Divide the average inventory by the cost of goods sold', 'Subtract the cost of goods sold from the average inventory', 'Multiply the cost of goods sold by the average inventory', 'Divide the cost of goods sold by the average inventory', 'Subtract the average inventory from the cost of goods sold', 'Multiply the ending inventory by the cost of goods sold, then divide by the beginning inventory', 'Add the cost of goods sold to the average inventory']\",\"question\":\"Describe a procedure that can be used to determine inventory turnover rate.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}