{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c2162a7-6269-5774-bf76-aee7c2301f5a","task_key":"all--test--3c2162a7-6269-5774-bf76-aee7c2301f5a","task_revision_id":"1","upstream_id":"","short_description":"According to Hardin, the \"ratchet effect\" refers to the fact that","config":"all","split":"test","body":"{\"choices\":\"['overpopulation does not affect the number of people who are poor.', 'overpopulation leads to creation of food banks that help curb poverty rates.', 'world hunger and poverty leads to recognition of rights not to be hungry.', 'the use of a world food bank to feed the hungry leads to an escalating series of emergency situations.']\",\"question\":\" According to Hardin, the \\\"ratchet effect\\\" refers to the fact that\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}