{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ea37f3e-6f99-5687-bad7-955a6aa04713","task_key":"all--test--4ea37f3e-6f99-5687-bad7-955a6aa04713","task_revision_id":"1","upstream_id":"","short_description":"A married couple signed a contract to sell their home, and in it they affirmed…","config":"all","split":"test","body":"{\"choices\":\"['No, because the facts do not indicate an intention to deceive by the sellers.', 'No, because buyers must always buy a used house in \\\"as is\\\" condition and they assume the risk of any hidden defects under the caveat emptor rule.', 'Yes, the evidence indicates that the sellers made knowingly false representations of material fact to induce the buyers to rely thereon and buy the property.', 'Yes, the sellers breached the contract of sale and must pay damages.']\",\"question\":\"A married couple signed a contract to sell their home, and in it they affirmed that they did not know of any structural defects in the home. Prior to the date of closing, the purchasers noticed peeling paint and plaster erosion in a corner of a ceiling near the fireplace. They also noticed water marks lining the interior wall in the basement. The sellers explained that these were old problems that had been fixed and they just didn't get around to doing the cosmetic repairs and painting. The parties went to closing and finalized the deal. On their first week in the house, the purchasers found a virtual flood plain in their basement and they confronted water gushing in at the corner areas near the fireplace. They hired a contractor who reported the need for extensive structural repairs. They sued the sellers for fraud, misrepresentation, and implied warranties of habitability, and they asked for the funds to fix the property. Do they have a valid cause of action against the sellers?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}