{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3244bb5d-aab7-542d-93e0-80620b0d7439","task_key":"default--test--9422","task_revision_id":"1","upstream_id":"9422","short_description":"A nonconducting sphere is given a nonzero net electric charge, +Q, and then…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['An electric field will be induced within the conducting sphere.', 'The spheres will experience an electrostatic attraction.', 'The nonconducting sphere will lose all its charge to the conducting sphere.', 'The spheres will not experience any electrostatic force.', 'The spheres will experience an electrostatic force, but it will not be significant.', 'The conducting sphere will develop a net electric charge of +Q.', \\\"The conducting sphere will remain neutral, regardless of the nonconducting sphere's charge.\\\", 'The conducting sphere will develop a net electric charge of –Q.', 'An electric field will be induced within the nonconducting sphere.', 'The spheres will experience an electrostatic repulsion.']\",\"question\":\"A nonconducting sphere is given a nonzero net electric charge, +Q, and then brought close to a neutral conducting sphere of the same radius. Which of the following will be true?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}