{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"022b494c-3113-5d2d-b223-87e26dfce2a5","task_key":"all--test--022b494c-3113-5d2d-b223-87e26dfce2a5","task_revision_id":"1","upstream_id":"","short_description":"A homeowner was injured when he slipped and fell in a puddle of water on his…","config":"all","split":"test","body":"{\"choices\":\"['No, because a franchisor has no duty to supervise the conduct of a franchisee.', 'No, under the rule that a manufacturer is liable only for defects in a product that existed at the time the product left the hands of the manufacturer.', 'Yes, because the installer was a franchisee of the manufacturer.', 'Yes, under the rule of apparent agency.']\",\"question\":\"A homeowner was injured when he slipped and fell in a puddle of water on his sunroom floor; the water had accumulated on the floor during a rainstorm because of leaks in the roof. The roof's manufacturer had supplied nondefective materials to the installer, who was a franchisee (and not an employee) of the manufacturer. The leaks resulted from the carelessness of the installer during the from the carelessness of the installer during the installation of the roof. The installer's truck, which had been parked in front of the homeowner's house during the roof installation, bore the manufacturer's logo. The manufacturer was aware that the truck and the literature supplied by the installer both displayed the manufacturer's logo. Is there any basis for a claim by the homeowner against the manufacturer?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}