{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ea36b2c2-ee72-5a1b-ac94-ae38a3dfd057","task_key":"all--test--ea36b2c2-ee72-5a1b-ac94-ae38a3dfd057","task_revision_id":"1","upstream_id":"","short_description":"Two objects, a sphere and a block of the same mass, are released from rest at…","config":"all","split":"test","body":"{\"choices\":\"['The sphere, because it gains rotational kinetic energy, but the block does not', 'The sphere, because it gains mechanical energy due to the torque exerted on it, but the block does not', 'The block, because it does not lose mechanical energy due to friction, but the sphere does', 'The block, because it does not gain rotational kinetic energy, but the sphere does']\",\"question\":\"Two objects, a sphere and a block of the same mass, are released from rest at the top of an inclined plane. The sphere rolls down the inclined plane without slipping. The block slides down the plane without friction. Which object reaches the bottom of the ramp first?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}