{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8de279d2-9682-56b9-b595-3b3417ba313d","task_key":"default--test--7433","task_revision_id":"1","upstream_id":"7433","short_description":"The price of labor is $2, and the price of capital is $1. The marginal product…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Decrease capital and increase labor so that the marginal product of capital falls and the marginal product of labor rises.', 'Increase capital and decrease labor so that the marginal product of capital rises and the marginal product of labor falls.', 'Increase both labor and capital so that both the marginal product of capital and labor rises.', 'Increase labor and keep capital constant so that the marginal product of labor falls and the marginal product of capital remains the same.', 'Decrease both labor and capital so that both the marginal product of capital and labor falls.', 'Keep labor constant and decrease capital so that the marginal product of labor remains the same and the marginal product of capital falls.', 'Keep labor constant and increase capital so that the marginal product of labor remains the same and the marginal product of capital rises.', 'Decrease capital and increase labor so that the marginal product of capital rises and the marginal product of labor falls.', 'Decrease labor and increase capital so that the marginal product of labor rises and the marginal product of capital falls.', 'Increase capital and decrease labor so that the marginal product of capital falls and the marginal product of labor rises.']\",\"question\":\"The price of labor is $2, and the price of capital is $1. The marginal product of labor is 200, and the marginal product of capital is 50. What should the firm do?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}