{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"488d0dd1-f782-5ec5-a430-8345acf7fec0","task_key":"all--test--488d0dd1-f782-5ec5-a430-8345acf7fec0","task_revision_id":"1","upstream_id":"","short_description":"Two cars were driving within the legal speed limit as they approached an…","config":"all","split":"test","body":"{\"choices\":\"['admitted as relevant evidence of a fact of consequence to the action.', 'admitted, provided that the jury is instructed about the danger of inferential negative evidence.', 'excluded, because it is improper negative evidence.', 'excluded, because the dangers of unfair prejudice and confusion of the issues may tend to mislead the jury.']\",\"question\":\"Two cars were driving within the legal speed limit as they approached an intersection. There are no traffic lights, stop signs, or warnings posted at this intersection. Both vehicles entered the intersection simultaneously and collided. In the accident, one of the drivers suffered a broken pelvis and internal injuries. Although the other driver's truck was slightly damaged, he did not suffer any physical injuries. Thereafter, the injured driver sued the city for negligence, claiming that the city failed to provide adequate warning at the intersection, which she contended was particularly dangerous and heavily traveled. At trial, the city attorney offers evidence that the intersection has been the same for 14 years, and no other accidents have occurred during that time. Upon objection by the injured driver's attorney, this evidence should be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}