{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1685a8dc-82e7-5613-8a45-54df41284575","task_key":"default--test--643","task_revision_id":"1","upstream_id":"643","short_description":"The Johnson Supply Company distributes its $3,160 of overhead on the basis of…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['$820, $1640, $620, $160', '$765, $1530, $645, $170', '$800, $1600, $650, $150', '$785, $1570, $640, $165', '$795, $1590, $625, $150', '$790, $1580, $632, $158', '$750, $1550, $600, $160', '$780, $1560, $630, $155', '$810, $1620, $660, $170', '$770, $1540, $610, $140']\",\"question\":\"The Johnson Supply Company distributes its $3,160 of overhead on the basis of square feet occupied. Find the amount charged to each of the following departments, given their respective areas. Department Area Raw Materials Manufacturing Storage Administrative 2,500 sq. ft. 5,000 sq. ft. 2,000 sq. ft 500 sq. ft.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}