{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c25ecc27-ba31-500e-9fbd-9f1ddea24c3a","task_key":"default--test--947","task_revision_id":"1","upstream_id":"947","short_description":"A state education agency, following all statutory requirements, obtained a…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Yes, eminent domain is restricted to taking property that is urgently needed for a public use and the failure to use it for that purpose defeated fee simple ownership in the agency.', 'Yes, because every eminent domain taking implies a fee simple determinable aspect to the governmental acquisition.', 'No, because the landowner accepted the fair market value and did not object to the transfer within the statutory period.', 'Yes, because the state agency did not fulfill its statutory obligations by failing to use the land for educational purposes.', 'Yes, because the landowner can always assert rights to land taken through eminent domain if the purpose is not fulfilled.', 'Yes, because the agency did not use the land for the purpose stated in the eminent domain proceedings within a reasonable time frame.', 'No, because the original transfer was legally conducted and the landowner received fair market value, thereby allowing a presumption of fee simple title in the agency.', 'No, because the original landowner forfeited all rights to the property once it was sold at the auction.', 'No, because the state also acquired fee simple title by adverse possession after 11 continuous, uninterrupted years of possession.']\",\"question\":\"A state education agency, following all statutory requirements, obtained a parcel of land through eminent domain. The landowner accepted the award of fair market value and did not appeal. For the next 15 years, the agency held the property but did not implement an educational use for it. In year 16, the agency abandoned the intended education use and sold it at a properly advertised auction under state law. The original landowner appealed, arguing that the agency only took a fee simple determinable and when it ceased its intended educational use, superior fee simple title reverted back to the original owner. Will the appellate court likely rule that the landowner can assert rights to stop the attempted transfer?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}