{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6fb6171e-7acb-5301-86fa-6a50f670a61c","task_key":"all--test--6fb6171e-7acb-5301-86fa-6a50f670a61c","task_revision_id":"1","upstream_id":"","short_description":"On October 15, an aspiring young actress entered into a written contract with a…","config":"all","split":"test","body":"{\"choices\":\"['The photographs, if subjectively viewed, were not satisfactory.', 'The photographs, if objectively viewed, were not satisfactory.', \\\"The photographs were not delivered on time, thereby resulting in a failure of condition precedent to the actress's liability.\\\", \\\"The photographer's injury constituted a temporary impracticability of performance, which excused his duty to perform for a reasonableperiod of time.\\\"]\",\"question\":\"On October 15, an aspiring young actress entered into a written contract with a nationally famous photographer. Their contractual agreement provided that the photographer was to supply the actress with twelve glossy prints \\\"designed to capture and convey the actress as a gifted dramatic actress with varied talents. \\\" Their contract further stipulated \\\"said twelve prints to be delivered on or before November 15; with payment of $1,500 thirty days thereafter. \\\" Another contractual provision recited that the photographer \\\"guarantees that the prints will be fully satisfactory and delivered on time. \\\"The following day, the photographer accidentally fell down a flight of stairs, and sustained a broken leg. As a result of his injury, the photographer was unable to photograph the actress until October 31. At that time he informed the actress that because of the delay, \\\"I am going to need a few more days beyond November 15 to make delivery. \\\" The actress responded, \\\"Please hurry with the pictures, because I need to submit my promotional portfolio for the leading role in an upcoming movie. \\\"The photographer diligently worked to speed production and delivered the prints to the actress's manager on November 18. After the manager looked over the photographs, she told the photographer, \\\"I'm sure these will be acceptable to my client. \\\" However, the following day the photographer received a telephone call from the actress, who said, \\\"These prints are just awful. They make me look horrible. I'm sending them back to you and not paying anything. Besides, these prints were two days late. \\\"If the actress initiates an action against the photographer for breach of contract, which of the following would be the photographer's best defense?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}