{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abe53a63-aee4-59bf-970a-4f7403f8a1a9","task_key":"all--test--abe53a63-aee4-59bf-970a-4f7403f8a1a9","task_revision_id":"1","upstream_id":"","short_description":"A city filed eminent domain proceedings in order to obtain 40 beach houses…","config":"all","split":"test","body":"{\"choices\":\"['No, because a property owner can challenge an exercise of eminent domain only on the ground of the sufficiency of the compensation.', 'No, because the planned sale to the private developer to increase the tourist trade qualifies as a public use.', 'Yes, because a public entity cannot seize the property of one person in order to transfer that property intact to other private parties.', \\\"Yes, because the city's action would deprive the owners of all economic use of their property.\\\"]\",\"question\":\"A city filed eminent domain proceedings in order to obtain 40 beach houses fronting a particularly attractive stretch of shoreline. As part of an elaborate plan to increase the city's tourist trade and revive the local economy, the city planned to sell the beach houses to a company that would demolish the houses and build a luxury hotel in their place. The owners of the beach houses have challenged the city's exercise of eminent domain, contending only that the city's plan is unconstitutional. Will the owners of the beach houses be likely to prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}