{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a77ff44-478e-5b07-82c9-8f8e36085ef5","task_key":"all--test--2a77ff44-478e-5b07-82c9-8f8e36085ef5","task_revision_id":"1","upstream_id":"","short_description":"A woman had her kitchen renovated. She purchased a new dishwasher, and the…","config":"all","split":"test","body":"{\"choices\":\"['recover, because the dishwasher was defectively made.', 'recover, because the manufacturer is vicariously liable for the improper installation.', 'not recover, because the friend assumed the risk by trying to open the dishwasher.', 'not recover, because the friend was not the purchaser of the dishwasher.']\",\"question\":\"A woman had her kitchen renovated. She purchased a new dishwasher, and the contractor doing the renovations installed it in the woman's kitchen. Two months later, the woman was entertaining a friend at her home. As they talked, they noticed that the dishwasher was operating strangely, repeatedly stopping and starting. They saw sparks start flying out from underneath the dishwasher. The friend said, \\\"It must have a short circuit or something. Don't touch it or you might get electrocuted. \\\" The woman asked if she should go down to the fuse box in her basement to cut off the electricity. The friend decided that he would take a look inside the dishwasher first. When he touched the metal handle on the dishwasher's door, he received a violent electric shock. The dishwasher had an internal wiring defect that caused it to malfunction. The contractor who installed the dishwasher failed to adequately ground the machine; if he had done so, the electric current would have been led harmlessly away. The machine carried instructions for proper grounding, but the contractor did not follow them. All of the relevant events occurred in a jurisdiction that follows traditional contributory negligence and assumption of risk rules. If the friend brings a strict tort liability claim against the manufacturer of the dishwasher for his injuries, the probable result is that the friend will\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}