{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e886a33e-fc74-5188-b632-c62fc93103ab","task_key":"all--test--e886a33e-fc74-5188-b632-c62fc93103ab","task_revision_id":"1","upstream_id":"","short_description":"A shopper slipped and fell on a wet spot at the local mall, suffering injuries.…","config":"all","split":"test","body":"{\"choices\":\"[\\\"granted, because the housekeeper's testimony is hearsay not within any recognized exception.\\\", \\\"granted, because the housekeeper's testimony would be self-serving.\\\", \\\"denied, because the housekeeper's testimony would be admissible as an adoptive admission.\\\", \\\"denied, because the shopper's statement to her housekeeper would be admissible as a declaration of present bodily condition.\\\"]\",\"question\":\"A shopper slipped and fell on a wet spot at the local mall, suffering injuries. The shopper has sued the mall owner for negligence. At trial, the shopper's housekeeper testified that the shopper was bedridden and unable to work for a month because of the sprained back she suffered when she fell at the mall. The housekeeper also testified that about one week after the shopper returned home from the hospital, the shopper told her, \\\"My back is really killing me. The pain is excruciating. It'll be a miracle if I can ever stand up again. \\\" The mall's counsel then moved to strike the housekeeper's testimony. The motion should be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}