{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e1acb9e6-169a-5f81-a83a-e238ac5eaf55","task_key":"all--test--e1acb9e6-169a-5f81-a83a-e238ac5eaf55","task_revision_id":"1","upstream_id":"","short_description":"Congress enacted a statute designed to make the stabilization of rents more…","config":"all","split":"test","body":"{\"choices\":\"['the rental of a state-owned office building by a state to a privately owned business.', 'the rental of residential property located in the District of Columbia by an individual landlord to a family of six.', 'the rental of an apartment located by a real estate company to an individual tenant.', 'the rental of an office building to a city by an individual landlord.']\",\"question\":\"Congress enacted a statute designed to make the stabilization of rents more effective throughout the United States. The statute will be applicable to all leasehold contracts hereafter entered into between landlords and tenants involving residential and commercial properties. The new federal statute is intended to protect tenants from spiraling rents and \\\"profiteering\\\" by landlords without curtailing the supply of rental units or depriving landlords of substantial constitutional rights. The new federal statute would be most clearly constitutional as applied to\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}