{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81f2806d-666b-5ba0-8a20-c611fb88821c","task_key":"all--test--81f2806d-666b-5ba0-8a20-c611fb88821c","task_revision_id":"1","upstream_id":"","short_description":"A farmer owns a large farm on which he allows his friends to hunt during…","config":"all","split":"test","body":"{\"choices\":\"[\\\"No, because the farmer is not responsible for his friends' conduct.\\\", 'No, because the neighbor was trespassing.', 'Yes, because the careless friend was permitted to hunt without safety training.', 'Yes, because the use of firearms is an abnormally dangerous activity.']\",\"question\":\"A farmer owns a large farm on which he allows his friends to hunt during quail-hunting season. He does not provide his friends with any instructions about gun safety. The neighbor who owns property adjacent to the farm knows of the friends' use of the property during the hunting season. One day during the hunting season, without the farmer's knowledge or permission, the neighbor took a shortcut across the farm to visit an acquaintance. The neighbor was wounded by a shot fired by one of the farmer's friends, who was shooting at quail and carelessly failed to see the neighbor. Traditional rules of landowners' and occupiers' liability apply. In an action by the neighbor against the farmer to recover for the injuries, will the neighbor be likely to prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}