{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be5ef772-ed14-5968-9da6-d94b79e5b558","task_key":"default--test--1733","task_revision_id":"1","upstream_id":"1733","short_description":"A housing corporation owned farmland and prepared a development plan to divide…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The restraint on alienation of his land is invalid.', 'The Declaration of Covenants is unenforceable because it is overly restrictive.', 'The Declaration of Covenants does not explicitly prohibit the conversion of single-family dwellings into businesses.', 'The chef has the right to use his property as he sees fit, regardless of the Declaration of Covenants.', 'The benefit is in gross; hence, the burden cannot run.', 'The chef was not aware of the Declaration of Covenants when he bought the property.', 'The assignment of rights to the city was invalid because the community association was terminated.', 'The burden is in gross; hence, the benefit cannot run.', 'The city is not in privity of estate with community association.']\",\"question\":\"A housing corporation owned farmland and prepared a development plan to divide the land into 100 lots and create a residential community on the farmland tract. The Declaration of Covenants created the community association, as an administrative entity, to which the residential community lot owners would pay dues, and which would administer and enforce the regulations and restrictions recited among the covenants. One of the restrictions set forth in the Declaration of Covenants provides that the lots be used only for single-family residences, and that no trade, commerce, or business may be conducted in any single-family residence. The Declaration of Covenants gives the community association the right to assign all of its rights, powers, titles, easements, and estates granted to it under the Declaration of Covenants. The community association assigned \\\"all the rights, powers, titles, easements, and estates granted to or conferred upon it by the Declaration of Covenants\\\" to a municipal corporation, the city. The community association was then terminated. A chef, the owner of lot 18 in the residential development, proposes to convert his single-family dwelling into a massage parlor. The city asserts an action against the chef to recover money damages. Which of the following is the best argument for the chef?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}