{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"57ced73f-a3bf-5fe3-b96a-ffc31d77f05d","task_key":"default--test--7594","task_revision_id":"1","upstream_id":"7594","short_description":"What is meant when it is said that \"the accelerator is asymmetric \"?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The accelerator inversely affects the level of investment and capital creation', 'The accelerator is only operational during periods of economic boom', 'The acceleration principle applies only when the required capital for a certain level of output is greater than the available capital, but does not apply in the reverse situation', 'The accelerator is a term used to describe the fluctuating interest rates on capital loans', 'The acceleration principle applies only when the available capital for a certain level of output is greater than the required capital, but does not apply in the reverse situation', 'The accelerator affects only the service sector but not the manufacturing sector', 'The accelerator applies equally to capital surplus and deficit', 'The accelerator only applies when required capital is less than available capital', 'The accelerator applies to the rate of technological innovation in capital goods', 'The accelerator refers to the rate of capital depreciation']\",\"question\":\"What is meant when it is said that \\\"the accelerator is asymmetric \\\"?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}