{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ebc4799e-21fa-511c-9979-50de318e9a8d","task_key":"default--test--2497","task_revision_id":"1","upstream_id":"2497","short_description":"What is an experimental control? Why is it important tohave experimentalcontrol?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['An experimental control is a way of taking into account the possible effect of an extraneous independent variable that is not considered in the hypothesis being tested.', 'An experimental control is the process of repeating experiments to ensure accuracy', 'An experimental control is an individual or group not exposed to the experimental treatment', 'An experimental control is a sample from a larger population used to make generalizations', 'An experimental control is the variable that the researcher changes to observe its effects', 'An experimental control is a tool for manipulating variables', 'An experimental control is a group or condition that remains constant throughout the experiment', 'An experimental control is a statistical analysis technique', 'An experimental control is a data collection method', 'An experimental control is the application of randomization in assigning participants to different conditions']\",\"question\":\"What is an experimental control? Why is it important tohave experimentalcontrol?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}