{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"16a07208-8d39-5a8f-a657-2660b74f565b","task_key":"default--test--9932","task_revision_id":"1","upstream_id":"9932","short_description":"A table supports a wooden block placed on the tabletop. Which fundamental force…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The electric force, because the inner electrons in the top atomic layer of the table attract the inner electrons in the bottom atomic layer of the wood.', 'The strong nuclear force, because the protons in the nuclei of the top atomic layer of the table repel the nuclei in the bottom atomic layer of the wood.', 'The electric force, because the outer electrons in the top atomic layer of the table repel the outer electrons in the bottom atomic layer of the wood.', 'The strong nuclear force, because the neutrons in the nuclei of the top atomic layer of the table attract the neutrons in the bottom atomic layer of the wood.', 'The weak nuclear force, because the protons in the nuclei of the top atomic layer of the table repel the nuclei in the bottom atomic layer of the wood.', 'The weak nuclear force, because the electrons in the top atomic layer of the table attract the electrons in the bottom atomic layer of the wood.', 'The gravitational force, because the mass of the table is attracting the mass of the wood.', 'The magnetic force, because the magnetic domains in the top atomic layer of the table repel the magnetic domains in the bottom atomic layer of the wood.', 'The gravitational force, because by F = GMm/r^2, the force of the table on the wood at that close range is sufficient to balance the force of the Earth on the wood.', 'The electric force, because the protons in the nuclei of the top atomic layer of the table repel the nuclei in the bottom atomic layer of the wood.']\",\"question\":\"A table supports a wooden block placed on the tabletop. Which fundamental force of nature is responsible for this interaction, and why?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}