{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5cf3fbee-111b-51d1-a6a0-1727032f7a70","task_key":"all--test--5cf3fbee-111b-51d1-a6a0-1727032f7a70","task_revision_id":"1","upstream_id":"","short_description":"Two identical containers are filled with different gases. Container 1 is filled…","config":"all","split":"test","body":"{\"choices\":\"['The average kinetic energy of the hydrogen gas is greater than the nitrogen gas.', 'The average force exerted on the container by the hydrogen gas is greater than the nitrogen gas.', 'The density of the hydrogen gas is less than the nitrogen gas.', 'The pressures of the gases cannot be compared without knowing the number of molecules in each container.']\",\"question\":\"Two identical containers are filled with different gases. Container 1 is filled with hydrogen and container 2 is filled with nitrogen. Each container is set on a lab table and allowed to come to thermal equilibrium with the room. Which of the following correctly compares the properties of the two gases?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}