{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7cf8455f-79d2-5f81-9576-d18f7cd19ec6","task_key":"all--test--7cf8455f-79d2-5f81-9576-d18f7cd19ec6","task_revision_id":"1","upstream_id":"","short_description":"A man and a woman are adjoining homeowners in a residential neighborhood. The…","config":"all","split":"test","body":"{\"choices\":\"['award damages, but not grant injunctive relief.', 'grant injunctive relief, but not award damages.', 'grant injunctive relief and award damages.', 'neither award damages nor grant injunctive relief, because there was no violation of any ordinance.']\",\"question\":\"A man and a woman are adjoining homeowners in a residential neighborhood. The man begins to operate a slaughterhouse in his backyard. The putrid smell from the slaughterhouse travels over the woman's property. The woman and her family members find the odor to be foul and nauseating. As a result of the man's slaughterhouse, the value of the woman's property was diminished by 20 percent, and the woman incurred expenses for prescription drugs to treat her family's nausea. There is no applicable zoning ordinance preventing the man's slaughterhouse operation. The woman has asserted a nuisance action against the man. The complaint seeks recovery for damages and injunctive relief enjoining operation of the slaughterhouse. The court should\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}