{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"db4a3edd-6c9a-5e25-ab9c-efea08f2f4c1","task_key":"default--test--10040","task_revision_id":"1","upstream_id":"10040","short_description":"A box of mass m slides on a horizontal surface with initial speed v0. It feels…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['2v0^2/(μg)', 'μv0^2/(2g)', 'v0^2/(2gμ)', 'v0^2/(μg^3)', 'v0^2/(μg)', '2μv0^2/g', 'v0^2/μg^2', 'v0^2/(2μg)', 'mv0^2/(μg)', 'mv0^2/(2μg)']\",\"question\":\"A box of mass m slides on a horizontal surface with initial speed v0. It feels no forces other than gravity and the force from the surface. If the coefficient of kinetic friction between the box and the surface is μ, how far does the box slide before coming to rest?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}