{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"298cee57-fb2c-5910-bdab-1e88a5ba2b5b","task_key":"default--test--2483","task_revision_id":"1","upstream_id":"2483","short_description":"Trace language development during preschool age.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['During preschool age, children learn an entirely new language spontaneously without prior exposure.', 'Language development during preschool age involves understanding complex grammatical rules without the ability to apply them in speech.', 'Language development during preschool age is limited to two-word sentences.', 'Preschool children develop the ability to write sentences before they can speak them.', \\\"Preschool children's language is limited to mimicking sounds without forming coherent words or sentences.\\\", 'During preschool age, children only learn how to perfectly use grammar without developing their vocabulary.', 'During preschool age, children communicate exclusively through non-verbal means and gestures, with no advancement in spoken language.', \\\"At preschool age, children's vocabulary shrinks before it begins to grow again.\\\", 'Language development regresses during preschool age.', 'During preschool age, the language development of the child progresses beyond the formation of two-word sentences. He begins to form three-word sentences and, from this point on, his language and grammar become more diverse and complex.']\",\"question\":\"Trace language development during preschool age.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}