{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa2d344a-0206-5715-9744-f11796e37b4a","task_key":"all--test--aa2d344a-0206-5715-9744-f11796e37b4a","task_revision_id":"1","upstream_id":"","short_description":"An owner of land entered into a month-to-month lease with a chemical company. At…","config":"all","split":"test","body":"{\"choices\":\"['The landowner is responsible under federal law regardless of whether it had knowledge or participated in the release of hazardous substances.', 'The court dismissed the action against the owner because federal law does not include innocent landowners in the regulatory scheme.', 'The court dismissed the action because liability for environmental hazards cannot be imposed simply because the owner has a contractual relationship with the offending tenant.', 'The court imposed liability on the landowner because he had a duty to inspect the property to determine what the tenant was doing there.']\",\"question\":\"An owner of land entered into a month-to-month lease with a chemical company. At first, the company stored raw materials and finished products on the leased land. Later, the company began recycling chemical waste at the property. There was a substantial release of toxic chemicals into the environment. The EPA ordered a clean-up of the property against the owner and the chemical company. The landowner defended the proceedings, claiming it did not know what the chemical company was doing. What will the court decide?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}