{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70e810a8-aa33-5bac-a8bc-2bf58e6c925b","task_key":"default--test--2048","task_revision_id":"1","upstream_id":"2048","short_description":"Describe Sherman's and Key's (1932) study of the Hollow Children. What do their…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The study found no significant findings', 'Environment has no effect on intellectual development', 'The study shows that a deprived environment only affects intellectual development until a certain age', 'The study concluded that intellectual development is solely determined by genetics, not environment', 'The findings indicate that a stimulating environment has no impact on intellectual development', \\\"Sherman and Key's study indicates that a deprived environment has a detrimental effect on intellectual development\\\", 'The research indicates that changes in the environment can reverse any prior intellectual development deficits', 'A deprived environment enhances intellectual development', \\\"Sherman and Key's research suggests that intellectual development is primarily influenced by peer interactions, not environment\\\", 'Sherman and Key found that intellectual development is equally impacted by both deprived and enriched environments']\",\"question\":\"Describe Sherman's and Key's (1932) study of the Hollow Children. What do their findings indicate about the effect of environment on intellectual development?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}