{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d57958d0-eb63-5906-b899-ecea37a6aa08","task_key":"all--test--d57958d0-eb63-5906-b899-ecea37a6aa08","task_revision_id":"1","upstream_id":"","short_description":"A state has enacted an abortion statute in an attempt to reconcile the…","config":"all","split":"test","body":"{\"choices\":\"[\\\"constitutional, because the state's statutestrikes a proper balance between the fundamental right of a woman to choose to terminatea pregnancy by abortion and the due processright to life of the unborn child.\\\", \\\"constitutional, because the state's statute issubstantially related to the important stateinterest in protecting the health and life of themother.\\\", \\\"unconstitutional, because the state's statuteimposes an undue burden on the right to obtainan abortion.\\\", 'unconstitutional, because it isirrational to impose virtually norestrictions on the right to obtain anabortion in the first trimester whileimposing significant restrictionson the right to obtain an abortionthereafter.']\",\"question\":\"A state has enacted an abortion statute in an attempt to reconcile the conflicting interests involved when a woman chooses to terminate a pregnancy by abortion. The state's statute provided that during the first trimester of pregnancy, a woman's right to choose to terminate the pregnancy was paramount and could not be restricted in any manner. After the first trimester, the right of a woman to obtain an abortion was limited to cases where it was demonstrated by a physician that an abortion was necessary to protect the life or health of the woman seeking the abortion. In all likelihood, this abortion statute is\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}