{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bffcd698-27b0-58fe-9e96-660443e07eb6","task_key":"default--test--10038","task_revision_id":"1","upstream_id":"10038","short_description":"A solid, metal object is isolated from other charges and has charge distributed…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['the electric field inside the object, but very close to the surface, is equal to the surface charge density at any location divided by the permittivity of free space', 'the electric field outside the object, but very close to the surface, is equal to the surface charge density at any location divided by the permittivity of free space', 'the electric field inside the object is directly proportional to the distance away from the center of mass of the object', 'electric field outside the object is zero', 'the electric field outside the object is inversely proportional to the distance away from the center of mass of the object', 'the electric field outside the object, but very close to the surface, is equal to the permittivity of free space divided by the surface charge density at any location', 'the electric field outside the object, but very close to the surface, is inversely proportional to the surface charge density at any location divided by the permittivity of free space', 'the electric field outside the object is equal to the electric field inside the object', 'the electric field inside the object is zero', 'the electric field outside the object is directly proportional to the distance away from the center of mass of the object']\",\"question\":\"A solid, metal object is isolated from other charges and has charge distributed on its surface. The charge distribution is not uniform. It may be correctly concluded that the\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}