{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eccf8837-44a8-5045-9ece-96444b66d89c","task_key":"all--test--eccf8837-44a8-5045-9ece-96444b66d89c","task_revision_id":"1","upstream_id":"","short_description":"A pregnant woman was sitting on her front porch watching her husband mow the…","config":"all","split":"test","body":"{\"choices\":\"['lose, because the friend did not intend for the woman to suffer a miscarriage.', \\\"lose, because the friend's actions were directed against the husband, not the woman.\\\", \\\"win, because it was highly probable that the friend's extreme and outrageous conduct would cause emotional distress to the woman.\\\", \\\"win, because she is the husband's wife.\\\"]\",\"question\":\"A pregnant woman was sitting on her front porch watching her husband mow the lawn. A friend of the woman had known the woman for years and knew that she was an easily excitable person. The friend also hated the woman's husband. Knowing that the woman was present, the friend drew a pistol and threatened to kill the husband. The woman suffered severe emotional distress as a result of witnessing this incident and soon afterward had a miscarriage. In an action by the woman against the friend for mental anguish resulting in her miscarriage, the woman will\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}