{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd6e0f5b-b47a-5924-b9bd-91c8bf85cccd","task_key":"all--test--cd6e0f5b-b47a-5924-b9bd-91c8bf85cccd","task_revision_id":"1","upstream_id":"","short_description":"On August 1, a mother hired a photographer to take a series of photographs of…","config":"all","split":"test","body":"{\"choices\":\"['By entering into the contract as written, the photographer assumed the risk that the mother would fail to cooperate in arranging for the taking of the photographs.', 'The mother was under an implied duty to act in good faith to reasonably cooperate with the photographer in arranging for the taking of the photographs.', \\\"An implied condition of the photographer's duty of performance was that the mother reasonably cooperate in arranging for the taking of the photographs.\\\", \\\"The mother's refusal to cooperate reasonably in arranging for the taking of the photographs would excuse the photographer from further obligation under the contract and also give the photographer a right of action against the mother for breach of contract.\\\"]\",\"question\":\"On August 1, a mother hired a photographer to take a series of photographs of her two-year-old daughter. The written contract called for the photographer \\\"to produce a minimum of six acceptable photographs by August 15. \\\" In exchange, the photographer was to be paid $200. Which of the following is the LEAST accurate statement with regard to the photographer's taking of the photographs?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}