{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6dd4c070-6762-56a5-8045-0c21d83572e9","task_key":"all--test--6dd4c070-6762-56a5-8045-0c21d83572e9","task_revision_id":"1","upstream_id":"","short_description":"A famous environmentalist was the owner of a large tract of virgin forest. The…","config":"all","split":"test","body":"{\"choices\":\"['fee simple determinable.', 'fee simple subject to condition subsequent.', 'easement appurtenant.', 'determinable fee subject to an executory interest.']\",\"question\":\"A famous environmentalist was the owner of a large tract of virgin forest. The environmentalist conveyed the tract \\\"to the people of the state in fee simple; provided, however, that if any portion of said tract shall ever be used or developed for any commercial purpose or otherwise converted from its natural state (with exception for recreational, scientific, or educational purposes), then the grantor or his successors in interest may re-enter as of the grantor's former estate. \\\"The interest of the state in the tract would be best described as a (an)\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}