{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3b507425-0b17-5855-bac9-be512caca936","task_key":"all--test--3b507425-0b17-5855-bac9-be512caca936","task_revision_id":"1","upstream_id":"","short_description":"A confined ideal gas undergoes a cyclical process in three steps—an isobaric…","config":"all","split":"test","body":"{\"choices\":\"['The change in internal energy of the gas is equal to the work done during the isobaric step.', 'The change in internal energy of the gas is equal to the work done during the isobaric step minus the work done during the isothermal step.', 'The total work done during the cycle is positive.', 'The total work done during the cycle is equal but opposite to the net amount of heat transferred.']\",\"question\":\"A confined ideal gas undergoes a cyclical process in three steps—an isobaric step, followed by an isochoric step, followed by an isothermal step. Which of the following must be true?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}