{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7e5a43f-8b5e-573b-adc6-4cf21e8b0622","task_key":"all--test--b7e5a43f-8b5e-573b-adc6-4cf21e8b0622","task_revision_id":"1","upstream_id":"","short_description":"Carens argues that, for example, liberal egalitarianism has nothing to say about…","config":"all","split":"test","body":"{\"choices\":\"['must not conflict with the rights and duties that liberal egalitarianism itself prescribes.', 'must be in accord with utilitarian moral considerations.', 'must not conflict with reasonable standards of prudence.', 'none of the above']\",\"question\":\" Carens argues that, for example, liberal egalitarianism has nothing to say about the question of whether a black doctor has a moral obligation to practice in a black community. This is because the only limit that liberal egalitarianism places on individuals' moral obligations, according to Caren, is that they\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}