{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ad837f4f-f84b-54dd-90db-ed13840ac561","task_key":"all--test--ad837f4f-f84b-54dd-90db-ed13840ac561","task_revision_id":"1","upstream_id":"","short_description":"A girl of mass m and a boy of mass 2m are sitting on opposite sides of a see-saw…","config":"all","split":"test","body":"{\"choices\":\"['Move the boy to half his original distance from the fulcrum.', 'Move the girl to double her original distance from the fulcrum.', 'Allow a second girl of mass m to join the first.', 'Move the fulcrum to half its original distance from the boy.']\",\"question\":\"A girl of mass m and a boy of mass 2m are sitting on opposite sides of a see-saw with its fulcrum in the center. Right now, the boy and girl are equally far from the fulcrum, and it tilts in favor of the boy. Which of the following would NOT be a possible method to balance the see-saw?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}