{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"208c0863-81b1-5995-9311-3133584e2c4a","task_key":"default--test--9110","task_revision_id":"1","upstream_id":"9110","short_description":"A sphere starts from rest atop a hill with a constant angle of inclination and…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Magnetic force', 'Static friction', 'Tension force', 'The inertia of the sphere', 'The normal force of the hill on the sphere', 'Gravity', 'Centrifugal force', 'The net force of the sphere', 'Kinetic friction', 'The force of friction between the sphere and the air']\",\"question\":\"A sphere starts from rest atop a hill with a constant angle of inclination and is allowed to roll without slipping down the hill. What force provides the torque that causes the sphere to rotate?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}