{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"33987e3b-dc5e-5d0c-9ebf-000cdbab8355","task_key":"all--test--33987e3b-dc5e-5d0c-9ebf-000cdbab8355","task_revision_id":"1","upstream_id":"","short_description":"A sporting goods shop contracted with a publisher to buy, for sale in its store,…","config":"all","split":"test","body":"{\"choices\":\"['No, because the nonconformity does not materially alter the value of the posters to the sporting goods shop.', 'No, because the publisher must be given an opportunity to cure the nonconformity before the sporting goods shop can reject the posters.', 'Yes, because the posters do not conform to the contract.', 'Yes, because the publisher has breached an implied warranty of fitness for a particular purpose.']\",\"question\":\"A sporting goods shop contracted with a publisher to buy, for sale in its store, 1,200 posters featuring a professional golfer. During production, the image of the golfer was inad-vertently reversed and the right-handed golfer appeared to be left-handed. When the posters were delivered on the date provided in the contract, the sporting goods shop noticed the discrepancy, which had no provable significant impact on the effectiveness of the poster. In the opinion of the shop man-agement, however, the posters did not look as good as they had in the catalog from which the shop had ordered them. Is the sporting goods shop legally entitled to reject the posters?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}