{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dcacd783-f626-5bf7-bb94-4e42916e226d","task_key":"default--test--1739","task_revision_id":"1","upstream_id":"1739","short_description":"A farmer was the fee-simple owner of a tract of land inthe country. The farmer…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['the farmer would lose, because he had abandoned the property for over 20 years.', 'the farmer would win, because the man had not paid property taxes during his occupancy.', \\\"the farmer would lose, because the man's possession was open, hostile, and continuous.\\\", 'the farmer would lose, because the man had fulfilled the required statutory period to become an adverse possessor.', 'the farmer would win, because the man did not have legal documentation of ownership.', 'the farmer would win, because the man had left the property for a year.', \\\"the farmer would win, because the man's possession was not continuous.\\\", 'the farmer would lose, because the man was the current resident of the property.', 'the farmer would win, because he is the titleholder of record.', 'the farmer would lose, because the man had made improvements on the land.']\",\"question\":\"A farmer was the fee-simple owner of a tract of land inthe country. The farmer moved to the city in 1986. Aman took possession of the land in 1987 as an adversepossessor and remained on the land from 1987 to 1997;he then left the property to care for his sick mother forone year, returning the following year, 1999. Assume that the statutory period for adverse possession in this state is 20 years. In 2010, the farmer wanted to move back to the tract because he desired to return to the country. Finding the man in possession, the farmer initiated a suit in ejectment against the man. The most probable judicial determination would be\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}