{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ebd5aa4b-d5bc-5ff4-a877-ddae649e48b4","task_key":"all--test--ebd5aa4b-d5bc-5ff4-a877-ddae649e48b4","task_revision_id":"1","upstream_id":"","short_description":"A 10-year-old girl decided to go sledding during a heavy snow and ice storm. She…","config":"all","split":"test","body":"{\"choices\":\"['No, if the classmate believed that the girl was in imminent peril when she pushed her off the sled.', 'No, unless the classmate acted unreasonably when she pushed the girl off the sled.', 'No, if the driver was driving negligently.', \\\"No, because the classmate had the girl's implied consent to act in an emergency.\\\"]\",\"question\":\"A 10-year-old girl decided to go sledding during a heavy snow and ice storm. She planned to go sledding down Hill Street, a steep and winding thoroughfare. Hill Street, which was located around the corner from the girl's home, was a popular sledding site because of its precipitous incline. The girl's parents had given her permission to sled down Hill Street. On the way to Hill Street, the girl met a classmate, who was 12, and asked if she wanted to join her. The classmate agreed, and the two girls walked to the top of Hill Street together. There, the youngsters mounted the sled. The girl was sitting in front and controlling the steering mechanism while the classmate was behind her. They started their descent at a relatively good speed. As they were about halfway down the road, they approached the intersection of Hill Street and Maple Drive. A driver, who was driving his car along Maple Drive, entered the intersection at the same time as the girls on the sled. When the classmate saw the driver's auto cross into their path, she shouted to the girl to fall off the sled. The girl became frightened and refused to jump off. Just before the sled collided with the car, the classmate pushed the girl off the sled. Her push caused the girl to fall and break her leg. The classmate couldn't get off the sled in time and was struck and injured by the driver's car. If the girl's parents, on behalf of their daughter, assert a claim against the classmate to recover damages for the girl's broken leg, will they prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}