{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"acd87de6-3760-5860-b90a-499db2ca04ae","task_key":"default--test--6923","task_revision_id":"1","upstream_id":"6923","short_description":"The production of a unit of good Y requires the employment of 3 workers and 7…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['MPPK = 0.25, total cost = $18', 'MPPK = 0.5, total cost = $19', 'MPPK = 1.5, total cost = $25', 'MPPK = 0.3, total cost = $17', 'MPPK = 0.9, total cost = $26', 'MPPK = 1, total cost = $21', 'MPPK = 0.4, total cost = $23', 'MPPK = 0.75, total cost = $22', 'MPPK = 0.8, total cost = $24', 'MPPK = 0.6, total cost = $20']\",\"question\":\"The production of a unit of good Y requires the employment of 3 workers and 7 units of capital. The going wage is $4. The rent on a unit of capital is $1. What should be the marginal physical product of capital in order for the production to be carried out at the least cost and what is this cost if the marginal physical product of labor is $2?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}