{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b531b563-8325-5ad9-a65b-8215c1b65f8d","task_key":"all--test--b531b563-8325-5ad9-a65b-8215c1b65f8d","task_revision_id":"1","upstream_id":"","short_description":"In support of her thesis that global social institutions violate the rights of…","config":"all","split":"test","body":"{\"choices\":\"[\\\"illicit cash flow to tax havens from rich countries exceeds aid to the world's poor.\\\", \\\"the implementation of neoliberal economic policies have had at mixed and at worse adverse impacts of the economic and social rights of the world's poor.\\\", 'that wealthy nations press their political and economic advantages to secure unfair trade agreements with poor countries.', 'all of the above']\",\"question\":\" In support of her thesis that global social institutions violate the rights of the world's poor, Ashford argues that\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}