{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f2c81fda-54c8-5556-801a-2d572e0770f6","task_key":"default--test--4702","task_revision_id":"1","upstream_id":"4702","short_description":"The secondarily altricial condition of modern human babies may have been an…","config":"default","split":"test","body":"{\"category\":\"history\",\"options\":\"['it resulted in babies being born with fully formed teeth.', 'it allowed for subsequent growth of the brain, since bipedalism had resulted in a narrowed birth canal in the female pelvis.', \\\"it led to an increase in the size of the newborn's head, allowing for a larger brain.\\\", 'the brain size of hominids had not grown for more than a million years, making it difficult for babies to walk.', 'it allowed babies to be born with an instinctive ability to swim.', 'it allowed for an earlier development of language skills in babies.', 'it allowed for bipedalism and independence from the mother at an earlier age.', 'it allowed for growth of the brain to nearly adult size prior to birth, since bipedalism had resulted in a wider birth canal in the female pelvis.', 'it allowed for the development of advanced motor skills at an earlier age.', 'it led to an increase in the gestation period allowing for the brain to fully develop before birth.']\",\"question\":\"The secondarily altricial condition of modern human babies may have been an evolutionary solution, in that:\",\"src\":\"ori_mmlu-prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}