{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b65896f-b189-57e5-aaca-c929d6ec7270","task_key":"default--test--6967","task_revision_id":"1","upstream_id":"6967","short_description":"Which of the following will shift the demand curve for the Mexican peso to the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['An increase in the international demand for Mexican-made textiles', 'Speculation that the peso will increase in value', 'A decrease in the international demand for Mexican-made textiles', 'An increase in the international demand for Mexican tourism', 'A stable rate of inflation in Mexico relative to other countries', 'A lower rate of inflation in Mexico relative to other countries', 'An increase in interest rates in Mexico relative to other countries']\",\"question\":\"Which of the following will shift the demand curve for the Mexican peso to the left?\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}