{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0dc2901-3748-5397-b131-f34a76bea55d","task_key":"default--test--2547","task_revision_id":"1","upstream_id":"2547","short_description":"Discuss two approaches that can be used in examining early language acquisition.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"Assessing the child's ability to follow complex instructions\\\", \\\"Measuring the number of words in the child's vocabulary and examining the quality of the acquired language\\\", \\\"Evaluating the frequency of the child's use of gestures and sign language\\\", \\\"Observing the child's interactions with peers during play\\\"]\",\"question\":\"Discuss two approaches that can be used in examining early language acquisition.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}