{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4d21c646-fd50-547d-86b0-09b0ac6555cd","task_key":"default--test--6926","task_revision_id":"1","upstream_id":"6926","short_description":"Why is it that on the whole, international stabilization schemeshave been only…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Lack of adequate funding', 'Lack of participation from major countries', 'Inefficiency in the management of the schemes', 'Failures due to inappropriate price settings and withdrawal from agreements when free market prices are favorable.']\",\"question\":\"Why is it that on the whole, international stabilization schemeshave been only moderately successful in their at-temptsto stabilize prices of various products such as wheat, rice, sugar and coffee?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}