{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3d178fe-539f-5858-a811-5eb35a274db5","task_key":"all--test--c3d178fe-539f-5858-a811-5eb35a274db5","task_revision_id":"1","upstream_id":"","short_description":"The will theory of rights maintains that the enforcement of Y's duty requires…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Regarding X's interest as directly related to Y's duty.\\\", 'Accepting that conferring right means that the interest represented by that right ought to be recognized.', 'Treating an interest as the exercise of choice.', 'Asserting that X has a right whenever the protection of his interest is recognized as a reason for imposing duties -only when they are actually imposed.']\",\"question\":\"The will theory of rights maintains that the enforcement of Y's duty requires the exercise of will by X. It assumes the correlativity of rights and duties. Which of the following succeeds in formulating the interest theory without this correlativity?\",\"subject\":\"jurisprudence\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}