{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7cf82c9a-4ae6-5d18-b56c-68bd3a32b0b5","task_key":"all--test--7cf82c9a-4ae6-5d18-b56c-68bd3a32b0b5","task_revision_id":"1","upstream_id":"","short_description":"One morning, a woman telephoned her next-door neighbor and asked if she could…","config":"all","split":"test","body":"{\"choices\":\"['admissible as circumstantial evidence that the woman was negligent on this occasion.', \\\"admissible, because the witness had personal knowledge of the woman's poor driving record.\\\", \\\"admissible against the neighbor as evidence of the woman's lack of fitness.\\\", 'inadmissible, because specific acts are not admissible except to rebut evidence of good character.']\",\"question\":\"One morning, a woman telephoned her next-door neighbor and asked if she could borrow her car. The woman explained that her car was being serviced and would not be ready for a couple of days. The woman told her neighbor that she had a doctor's appointment that afternoon and would return the car immediately afterwards. The neighbor agreed and gave the woman permission to use her car. As the woman was driving to her doctor's office, she collided with another car. As a result of the accident, the other driver brought suit against the woman and the neighbor to recover for her personal injuries. The other driver asserted a claim against the neighbor for negligent entrustment of an automobile and charged the woman with negligent operation of a motor vehicle. In her case-in-chief, the other driver called a witness to testify to three incidents of careless driving on the woman's part during the past six months. The trial judge should rule the testimony\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}