{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36b61da7-2afe-5725-b779-affe77c605f8","task_key":"default--test--1272","task_revision_id":"1","upstream_id":"1272","short_description":"The owner of real estate neglected to pay his real estate tax bills. The county…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The notice was sufficient as the county followed all the legal procedures required.', 'The county did not provide adequate notice as they did not post the notice on the property itself.', 'The notice was inadequate as the county did not attempt to contact the owner via telephone or email.', 'Additional attempts at notice are required if at all possible when the county knows in advance that its methods were returned as unclaimed.', 'Certified mail addressed to the owner of the property is always sufficient notice for due process purposes.', 'The method of notice was sufficient as the owner had neglected to update his contact information with the county.', 'The notice was adequate as it was published in the local newspaper.', 'The notice was adequate because it was sent twice and was fairly calculated to get to the right person.', \\\"The county's notice was inadequate because it must have the sheriff serve the notice personally on the owner under U.S. Supreme Court precedent.\\\"]\",\"question\":\"The owner of real estate neglected to pay his real estate tax bills. The county tax bureau sent a notice by certified mail to him at the property address informing that the property would be sold at a public sale if the taxes were not paid. Nobody was home to sign for the letter and nobody claimed it. It was returned to the county marked \\\"unclaimed.\\\" One year later the property was advertised in the local newspaper and exposed to public sale. Prior to completing the sale, the county sent another notice to the owner that came back \\\"unclaimed.\\\" The buyer at the sale tried to evict the owner. The owner filed a complaint against the county and the buyer claiming a taking of his property without due process. The state courts held that the procedure complied with due process notice. The case came before the U.S. Supreme Court. What was the likely decision of the Supreme Court regarding the method of notice provided here?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}