{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6095120f-23be-59c2-b886-71b80464e951","task_key":"all--test--6095120f-23be-59c2-b886-71b80464e951","task_revision_id":"1","upstream_id":"","short_description":"A female patient at a federal hospital reported that a male nurse sexually…","config":"all","split":"test","body":"{\"choices\":\"['The evidence is too prejudicial and must be excluded.', 'The evidence is inadmissible because it is not relevant to the present charges and has a low probative value.', 'The evidence is admissible because present public policy strongly favors the apprehension and prosecution of sexual predators.', 'The evidence is admissible due to the factual similarity with the present charge, which gives the evidence strong probative value.']\",\"question\":\"A female patient at a federal hospital reported that a male nurse sexually assaulted her. The man was arrested. At trial the prosecution offered evidence that the man was convicted of two prior sexual assault charges against two other women, both occurring about two years earlier. The allegations and the man's modus operandi in those convictions were almost identical to the instant case. Defense counsel objected to the evidence on the basis that its highly prejudicial effect outweighed its probative value. Based on the Federal Rules of Evidence, what will the court most likely rule regarding this issue?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}