{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5765ee5e-e546-5f91-b01b-4f8cccdf529d","task_key":"default--test--476","task_revision_id":"1","upstream_id":"476","short_description":"Solve the following problems. (a) A plot of land containing 487 (1/2) acres were…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['145 plots, 45 graduating seniors with an A average, 6100 containers', '160 plots, 40 graduating seniors with an A average, 7000 containers', '135 plots, 65 graduating seniors with an A average, 5900 containers', '130 plots, 60 graduating seniors with an A average, 5000 containers', '125 plots, 75 graduating seniors with an A average, 5600 containers', '142 plots, 52 graduating seniors with an A average, 5800 containers', '155 plots, 42 graduating seniors with an A average, 6300 containers', '150 plots, 50 graduating seniors with an A average, 6000 containers', '140 plots, 55 graduating seniors with an A average, 6500 containers', '138 plots, 48 graduating seniors with an A average, 6200 containers']\",\"question\":\"Solve the following problems. (a) A plot of land containing 487 (1/2) acres were broken up into smaller plots containing 3 (1/4) acres apiece. Find the number of smaller plots that were formed. (b) 450 freshmen entered ahighschool. Of these only (2/3) will graduate four years later. Of those that graduate, (1/6) will receive an A average. Find how many graduating seniors will have an A average. (c) TheGoreman'sGlue Factory wishes to package 4,000 pints of glue in containerthat hold (2/3) pint each. How may containers are needed?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}