{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cc411056-3e6f-5d54-8b2c-4fe41d35ee53","task_key":"all--test--cc411056-3e6f-5d54-8b2c-4fe41d35ee53","task_revision_id":"1","upstream_id":"","short_description":"A minor-plaintiff suffered permanent head injuries as a result of being hit by a…","config":"all","split":"test","body":"{\"choices\":\"['competent to testify, because he had personal knowledge of the accident.', 'competent to testify, because a seven-year-old is presumed to be chronologically mature.', 'incompetent, because he lacked the capacity to perceive and relate the accident at the time of its occurrence.', 'incompetent, because all children under the age of 10 are deemed incompetent to testify.']\",\"question\":\"A minor-plaintiff suffered permanent head injuries as a result of being hit by a car driven by a defendant. The plaintiff's father commences this action as a parent in his own right and on behalf of his son. At trial, the plaintiff's attorney called the only witness to the accident, the plaintiff's friend, aged seven. The friend was four years of age at the time of the accident. It was determined that the friend lacked the capacity to perceive and relate the accident at the time it actually occurred. The court should rule that the friend would be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}