{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45b7bc25-7b6c-5cbd-b384-bcfbae91ea46","task_key":"default--test--10326","task_revision_id":"1","upstream_id":"10326","short_description":"Two objects, a sphere and a block of the same mass, are released from rest at…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The block, because it slides down faster due to its shape', 'The block, because it does not gain rotational kinetic energy, but the sphere does', 'The sphere, because it has less surface area in contact with the ramp', 'Both reach at the same time, as gravity acts equally on both objects', 'The block, because it has more surface area in contact with the ramp', 'The sphere, because its shape allows it to roll faster', 'The sphere, because it gains mechanical energy due to the torque exerted on it, but the block does not', 'The sphere, because it gains rotational kinetic energy, but the block does not', 'Both reach at the same time, as they both have the same mass', 'The block, because it does not lose mechanical energy due to friction, but the sphere does']\",\"question\":\"Two objects, a sphere and a block of the same mass, are released from rest at the top of an inclined plane. The sphere rolls down the inclined plane without slipping. The block slides down the plane without friction. Which object reaches the bottom of the ramp first?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}