{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ae97b15-b1c4-5d80-9252-c05abac4e57a","task_key":"all--test--6ae97b15-b1c4-5d80-9252-c05abac4e57a","task_revision_id":"1","upstream_id":"","short_description":"Brood parasites such as the cuckoo successfully trick other species of birds…","config":"all","split":"test","body":"{\"choices\":\"[\\\"on average, the host birds' response allows them to rear their own young efficiently by feeding only those who indicate they are hungry\\\", 'the maximum fitness of the duped bird is not compromised when the bird rears an interloper of another species', \\\"on average, little energy is spent on rearing a fledgling bird, whether it is an interloper or one's own\\\", 'the maximum fitness of the cuckoo would then be reduced']\",\"question\":\"Brood parasites such as the cuckoo successfully trick other species of birds into rearing their young by exploiting the host birds' instinctive response to the loud begging cues of a fledgling in their nest. The genes that allow the host bird species to be duped into rearing the cuckoo fledglings to the detriment of their own offspring most likely remain in the gene pool of the population because\",\"subject\":\"college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}