{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8f2ae091-6ecb-59e3-9b09-5124473bc45a","task_key":"default--test--9203","task_revision_id":"1","upstream_id":"9203","short_description":"A 1-kg object is released from rest at the top of a rough-surfaced incline. The…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Equal to the block’s gravitational potential energy when it was released, because total mechanical energy must be conserved.', 'Equal to zero, because the object loses all its energy due to the roughness of the incline.', 'Less than the block’s gravitational potential energy when it was released, because the work done by the friction force must be greater than the block’s gain in kinetic energy.', 'Greater than the block’s gravitational potential energy when it was released, because the object gains energy from the friction on the rough incline.', 'Greater than the block’s gravitational potential energy when it was released, because the kinetic energy increases as the object slides down the incline.', 'Less than the block’s gravitational potential energy when it was released, because the gravitational potential energy was converted both to thermal energy and to kinetic energy.', 'Equal to the block’s gravitational potential energy when it was released, because the object does not lose any energy while sliding down.', 'Less than the block’s gravitational potential energy when it was released, because the object loses energy due to the air resistance.', 'More than the block’s gravitational potential energy when it was released, because the object gains speed while sliding down.', 'Equal to the block’s gravitational potential energy when it was released, because the gain in kinetic energy compensates for the mechanical energy lost to thermal energy on the rough incline.']\",\"question\":\"A 1-kg object is released from rest at the top of a rough-surfaced incline. The object slides without rotating to the bottom of the incline. The object’s kinetic energy at the bottom must be\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}