{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f47bca2-082c-5b2d-b2b8-2c87fc011918","task_key":"default--test--4507","task_revision_id":"1","upstream_id":"4507","short_description":"Formation of a solution can often be visualized as a three-step process. Step 1.…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['Step 1 is endothermic, steps 2 and 3 are exothermic.', 'All three steps are endothermic.', 'Steps 1 and 3 are exothermic, and step 2 is endothermic.', 'All three steps are exothermic.', 'Steps 1 and 3 are endothermic, and step 2 is exothermic.', 'Step 1 is exothermic, steps 2 and 3 are endothermic.', 'Step 3 is exothermic, steps 1 and 2 are neither exothermic nor endothermic.', 'Step 1 and 2 are exothermic, step 3 is neither exothermic nor endothermic.', 'Steps 1 and 2 are exothermic, and step 3 is endothermic.', 'Steps 1 and 2 are endothermic, and step 3 is exothermic.']\",\"question\":\"Formation of a solution can often be visualized as a three-step process. Step 1. Solvent molecules are separated from each other to make space for the solute. Step 2. Solute molecules are separated so they fit into spaces in the solvent. Step 3. Separated solute and solvent are brought together, filling in the spaces. Which of the following statements about the energy involved in the above is correct?\",\"src\":\"ori_mmlu-high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}