{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"733b26cb-0661-585f-b50c-1a8af7a4b620","task_key":"all--test--733b26cb-0661-585f-b50c-1a8af7a4b620","task_revision_id":"1","upstream_id":"","short_description":"A plaintiff brought an action against a defendant for personal injuries…","config":"all","split":"test","body":"{\"choices\":\"['admissible as a spontaneous declaration.', 'admissible under the hearsay exception of declaration of present bodily condition.', 'inadmissible as hearsay not within any recognized exception.', 'inadmissible as conclusions.']\",\"question\":\"A plaintiff brought an action against a defendant for personal injuries resulting from a car accident in which the defendant's car, negligently driven by his cousin, struck the telephone booth in which the plaintiff was resting. Liability is based on a statute making owners of automobiles liable for the negligent actions of those driving with the consent of the owner of the vehicle. The plaintiff offered into evidence the testimony of his doctor that the plaintiff had said to the doctor, when consulting the doctor for treatment, that he felt pain in his back immediately after the accident, and that pain persisted. The trial court should rule this testimony\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}