{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69eb2b9e-06a0-5943-ba7a-92704c0cfb35","task_key":"all--test--69eb2b9e-06a0-5943-ba7a-92704c0cfb35","task_revision_id":"1","upstream_id":"","short_description":"In his objection to \"the second prong of the libertarian case for open borders,\"…","config":"all","split":"test","body":"{\"choices\":\"['He would say this begs the question because the immigration question is identical to the freedom-of-movement question.', 'He would present an argument showing that there is actually no right to freedom of movement.', \\\"He would argue that some rights are not absolute (e.g., the right to marriage doesn't allow you to marry an unwilling partner).\\\", 'He would use deontological premises to deductively conclude that unjust public policies are morally objectionable.']\",\"question\":\" In his objection to \\\"the second prong of the libertarian case for open borders,\\\" Wellman responds to the objection that he is essentially denying that we have a right to freedom of movement. Which of the following is part of his response?\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}