{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14a71589-f287-5fa5-880c-03e9382736c5","task_key":"default--test--7681","task_revision_id":"1","upstream_id":"7681","short_description":"The \"crowding-out\" effect refers to which of the following?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Higher interest rates that result from borrowing to conduct contractionary fiscal policy', 'Lower interest rates that result from borrowing to conduct expansionary monetary policy', 'Lower interest rates due to borrowing to conduct contractionary fiscal policy', 'Lower interest rates resulting from reduced borrowing due to expansionary fiscal policy', 'Lower interest rates due to increased borrowing to conduct expansionary monetary policy', 'Higher interest rates that result from borrowing to conduct expansionary fiscal policy', 'Higher interest rates due to borrowing to conduct contractionary monetary policy', 'Higher interest rates due to borrowing to conduct neutral monetary policy', 'Higher interest rates due to borrowing to conduct neutral fiscal policy', 'Higher interest rates resulting from reduced borrowing due to contractionary fiscal policy']\",\"question\":\"The \\\"crowding-out\\\" effect refers to which of the following?\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}