{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d613a5a-3990-5d59-9be8-264ee3e5ef05","task_key":"all--test--6d613a5a-3990-5d59-9be8-264ee3e5ef05","task_revision_id":"1","upstream_id":"","short_description":"Two volleyball teams that played in adjoining areas were competing in the…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because the assistant coach was recording the conversation for the use and advantage of his team.', 'Yes, because the team captain had a reasonable expectation of privacy in his hotel room.', \\\"No, because the assistant coach's electronic devices did not physically intrude into the team captain's room.\\\", 'No, because there was publication of the recorded conversations.']\",\"question\":\"Two volleyball teams that played in adjoining areas were competing in the National Volleyball Tournament Championship in a distant city. Both teams were staying at the same hotel. The assistant coach of one of the teams learned that the team captain of the other team was staying in the next room. In order to obtain information about the other team's strategy for the championship game, the assistant coach used electronic devices placed against the wall to listen to and record conversations between the team captain and his teammates. The assistant coach later bragged to others about having eavesdropped on the team captain, and the team captain eventually heard about what the assistant coach had done. If the team captain asserts a claim against the assistant coach for invasion of privacy, will the team captain prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}