{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eda00019-1385-55c9-88c2-631face0fe89","task_key":"all--test--eda00019-1385-55c9-88c2-631face0fe89","task_revision_id":"1","upstream_id":"","short_description":"An experienced equestrian rider sued a woman, claiming that her horse kicked and…","config":"all","split":"test","body":"{\"choices\":\"['inadmissible as an improper form of impeachment.', 'inadmissible as substantive evidence to show that the horse must have been provoked.', \\\"inadmissible, because the horse's general propensity cannot be used to prove what occurred on a particular occasion.\\\", \\\"inadmissible as beyond the scope of the woman's direct testimony.\\\"]\",\"question\":\"An experienced equestrian rider sued a woman, claiming that her horse kicked and injured the rider. At trial, the rider testified that he was attending a horse show when, without provocation, he was kicked by a gray stallion with a black tail. The rider then called the woman as an adverse witness and asked her the following question: \\\"Isn't it true that you are the owner and trainer of a gray stallion with a black tail?\\\" After answering affirmatively, the woman was not asked any further questions on direct examination. Whereupon in cross- examination, the woman was then asked, \\\"Isn't it true that your horse is very gentle and would not kick anyone unless provoked?\\\"Upon objection by the rider's attorney, the rider's strongest argument would be that the woman's proffered testimony is\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}