{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"980c02c3-8dcc-54f6-b316-025ba9b85052","task_key":"all--test--980c02c3-8dcc-54f6-b316-025ba9b85052","task_revision_id":"1","upstream_id":"","short_description":"West argues that feminist legal theory has inadvertently led to the…","config":"all","split":"test","body":"{\"choices\":\"['it posits that all sex is rape.', 'by suggesting that the harm of rape is that it is nonconsensual, it implies that all consensual sex is good.', \\\"by suggesting that the harm of rape has nothing to do with the victim's gender, it implies that women are not especially harmed by nonconsensual sex.\\\", 'all of the above.']\",\"question\":\" West argues that feminist legal theory has inadvertently led to the under-acknowledgement of the harms of consensual sex because\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}