{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a06d5a1-be93-5873-b184-46161f01529e","task_key":"all--test--1a06d5a1-be93-5873-b184-46161f01529e","task_revision_id":"1","upstream_id":"","short_description":"A college student attended a fraternity party. He noticed a young woman flirting…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Yes, because the rules permit evidence of a victim's sexual predisposition to test credibility.\\\", 'Yes, because the evidence will help the jury see that there may be two sides to the story and that the woman was thus the sexual predator instead of the man.', 'No, because such \\\"sexual predisposition\\\" evidence is generally prohibited by the rules of evidence except under narrow exceptions.', \\\"No, because the rules of evidence prohibit all evidence of a victim's prior sexual history.\\\"]\",\"question\":\"A college student attended a fraternity party. He noticed a young woman flirting with him in a sexually suggestive way. He took her home and ended up forcefully raping her against her will. She escaped after the rape and went directly to the authorities. The police filed charges of rape. The student-defendant found several men willing to testify that the woman was promiscuous, that they had relations with her and that she was very prolific in her sexual life. Will the trial court likely permit the witnesses to testify to the woman's sexual predisposition under the Federal Rules of Evidence?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}