{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"44d3028f-a914-5fe4-9329-55e79565042e","task_key":"default--test--1369","task_revision_id":"1","upstream_id":"1369","short_description":"A woman was the fee simple owner of a 20-acre tract of land. When the woman…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The man will not acquire title unless he continues in adverse possession for an additional seven years, or until the son reaches the age of 25.', 'The man will not acquire title unless he continues in adverse possession for an additional three years, or until the son reaches the age of 18.', 'The man has acquired title by adverse possession.', 'The man will acquire title by adverse possession only if the son does not claim the land before he turns 18.', 'The man has not acquired title by adverse possession because the woman was not aware of his possession at the time of her death.', \\\"The man has not acquired title by adverse possession because the son was a minor at the time of the woman's death.\\\", \\\"The man will not acquire title unless he continues in adverse possession for an additional eight years, making a total of 12 years after the woman's death.\\\", 'The man will not acquire title unless he continues in adverse possession for an additional 12years, or nine years after the son attains the ageof 18.', 'The man will acquire title by adverse possession only if he continues in possession for a total of 30 years.']\",\"question\":\"A woman was the fee simple owner of a 20-acre tract of land. When the woman moved to another state, a man took possession of the tract. The man's possession has at all times complied with the requirements of the applicable adverse possession statute in effect. Twelve years after the man took possession, the woman died intestate, leaving her six-year-old son as her only surviving heir. Nine years after the woman's death, when the son was 15, the son's guardian discovered that the man was in possession of the tract. Assume that the statutory period of adverse possession is 20 years and the age of majority is 18. Which of the following correctly describes the state of title to the tract?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}