{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4b286f1-a680-52a8-87f4-b3459c219e9d","task_key":"all--test--d4b286f1-a680-52a8-87f4-b3459c219e9d","task_revision_id":"1","upstream_id":"","short_description":"A 15-year-old boy was sledding down a pathway through a wooded area of land…","config":"all","split":"test","body":"{\"choices\":\"['recover, under the \\\"attractive nuisance\\\" doctrine.', 'recover, because the woman knew or should have known of the frequent trespasses.', 'not recover, because the boy was a trespasser.', 'not recover, because a 15-year-old boy should have realized the risk.']\",\"question\":\"A 15-year-old boy was sledding down a pathway through a wooded area of land owned by a woman. The boy had frequently used the pathway for sledding in the previous months. The path, made of concrete, led through the woods from a public highway to a pond in the rear of the woman's property. The pathway was used for sledding and the pond for skating by the residents of the neighboring areas, without the consent of the woman. Furthermore, the woman failed to post any signs forbidding trespassing. After the boy had been sledding down the pathway for approximately three hours one morning, he lost control of the sled, and steered it into a tree. The boy suffered serious injuries in the crash. If a suit is brought on the boy's behalf against the woman for the boy's personal injuries, the plaintiff will\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}