{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e0e1b64-738b-5fff-9a65-374a3773d9c7","task_key":"default--test--4431","task_revision_id":"1","upstream_id":"4431","short_description":"The first ionization energy for a neutral atom of chlorine is 1.25 MJ/mol and…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['It would be greater than both because the size of a potassium atom is smaller than an atom of either chlorine or argon.', 'It would be greater than both because the atomic radius of potassium is greater than that of either chlorine or argon.', 'It would be less than both because there are more electrons in potassium, meaning they repel each other more effectively and less energy is needed to remove one.', 'It would be less than chlorine but greater than argon because the atomic radius of potassium is smaller than that of argon but larger than that of chlorine.', 'It would be greater than chlorine but less than argon because the atomic number of potassium falls between those of chlorine and argon.', 'It would be greater than both because potassium carries a greater nuclear charge then either chlorine or argon.', 'It would be equal to that of argon because they belong to the same period in the periodic table.', 'It would be less than both because a valence electron of potassium is farther from the nucleus than one of either chlorine or argon.', 'It would be equal to that of chlorine because both are in the same group in the periodic table.', 'It would be less than both because potassium has fewer protons to attract electrons, making it easier to remove one.']\",\"question\":\"The first ionization energy for a neutral atom of chlorine is 1.25 MJ/mol and the first ionization energy for a neutral atom of argon is 1.52 MJ/mol. How would the first ionization energy value for a neutral atom of potassum compare to those values?\",\"src\":\"ori_mmlu-high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}