{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7ad1255-4520-5c60-ae7d-bf8e53b32ed9","task_key":"default--test--3987","task_revision_id":"1","upstream_id":"3987","short_description":"When potassium perchlorate, KClO4, dissolves in water, the temperature of the…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['This process is non-spontaneous and exothermic.', 'This process is spontaneous because it is endothermic.', 'This is a spontaneous process because of an entropy increase.', 'This is a spontaneous process because it is exothermic.', 'This process is non-spontaneous due to an entropy increase.', 'This is a spontaneous process because of an entropy decrease.', 'This is a non-spontaneous process because it is endothermic.', \\\"The process is spontaneous and doesn't involve any heat exchange.\\\", 'This is a non-spontaneous process due to an entropy decrease.']\",\"question\":\"When potassium perchlorate, KClO4, dissolves in water, the temperature of the resultant solution is lower than the initial temperature of the components. Which of the following conclusions may be related to this?\",\"src\":\"ori_mmlu-high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}