{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24e5e8b7-6870-55c6-8fc6-1da81d28e09e","task_key":"all--test--24e5e8b7-6870-55c6-8fc6-1da81d28e09e","task_revision_id":"1","upstream_id":"","short_description":"A city sent a certified notice by U.S. mail to a homeowner telling the owner…","config":"all","split":"test","body":"{\"choices\":\"[\\\"No, because the sending of certified notice to the property's address was reasonably calculated to reach him, which satisfies due process concerns.\\\", \\\"No, because the owner knew that he wasn't paying his taxes and that constituted de facto notice that that his property was subject to governmental taking.\\\", 'Yes, because in most circumstances an \\\"unclaimed\\\" notification is insufficient to satisfy the demands of due process.', 'No, because the city had a right to expect that an owner will leave his property in the hands of someone who will notify him if his interest is in jeopardy.']\",\"question\":\"A city sent a certified notice by U.S. mail to a homeowner telling the owner that the property was listed for a foreclosure sale for failure to pay real estate property taxes. The post office quickly returned the notice to the city as being \\\"unclaimed.\\\" The city decided that the notice was sufficient, and sold the property. The owner had been out of the country and did not claim his certified mail. When he found out he sued the city on the basis that there was insufficient notice. Will the owner succeed in having the foreclosure declared void by the court?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}