{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7fa92995-b557-5034-af1f-0b59c9fd3747","task_key":"default--test--4158","task_revision_id":"1","upstream_id":"4158","short_description":"The bond length between any two nonmetal atoms is achieved under which of the…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['The point at which the repulsive forces between the two atoms are equal', 'Where the nucleus of one atom exhibits the strongest attraction to the electrons of the other atom', 'Where the electrons of each atom exhibits the strongest attraction to the nucleus of the other atom', 'Where the energy of interaction between the atoms is at its minimum value', 'The point at which the attractive forces between the two atoms outweigh the repulsive forces', 'The furthest point at which a valence electron from one atom can transfer to the other atom', 'Where the energy of interaction between the atoms is at its maximum value', 'The closest point at which a valence electron from one atom can transfer to the other atom', 'Where the nuclei of each atom exhibits the strongest attraction to the electrons of the other atom']\",\"question\":\"The bond length between any two nonmetal atoms is achieved under which of the following conditions?\",\"src\":\"ori_mmlu-high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}