{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb8f1b24-b7d8-5c30-877a-a25f17b702f9","task_key":"all--test--eb8f1b24-b7d8-5c30-877a-a25f17b702f9","task_revision_id":"1","upstream_id":"","short_description":"A rancher owned a 2,000-acre cattle ranch in a remote section of the state. For…","config":"all","split":"test","body":"{\"choices\":\"[\\\"the legal cause of the cowboy's death, but not the cause-in-fact.\\\", \\\"the cause-in-fact of the cowboy's death, but not the legal cause.\\\", \\\"the legal cause and the cause-in-fact of the cowboy's death.\\\", \\\"neither the legal cause nor the cause-in-fact of the cowboy's death.\\\"]\",\"question\":\"A rancher owned a 2,000-acre cattle ranch in a remote section of the state. For some time the rancher's cattle had been seized upon by roaming packs of wolves. In order to protect his livestock from these attacks, the rancher erected a fence around his property. In addition, the rancher installed electrical wiring on the fence. The wiring transmitted an electric current, which would emit a shock upon contact with the fence. Although the voltage was calculated to frighten animals away from the fence, it was of such low intensity that it posed no risk of injury to a human being, even a small child. Consequently, the rancher did not post any notice of the electrical wiring device. One day, a cowboy was riding his horse along the outskirts of the rancher's property, when a gust of wind blew his hat onto the fence. The cowboy, who had undergone major heart surgery, wore a pacemaker. When the cowboy touched the top of the fence to retrieve his hat, the electric current short- circuited his pacemaker, resulting in the cowboy's death by electrocution. In a wrongful death action by the cowboy's estate against the rancher, the installation of the electrical wiring device would most likely constitute\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}