{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ce11576-9eaf-53fc-90c9-3caa3ad41a75","task_key":"default--test--6979","task_revision_id":"1","upstream_id":"6979","short_description":"If total product of labor is rising at an increasing rate,","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['marginal product of labor is at its minimum.', 'average product of labor is at its maximum.', 'total cost of production is decreasing.', 'average product of labor is falling.', 'marginal product of labor is rising.', 'marginal cost is rising.', 'marginal product of labor is constant.', 'marginal product of labor is falling.', 'marginal product of labor is at its maximum.', 'total product of labor is at its maximum.']\",\"question\":\"If total product of labor is rising at an increasing rate,\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}