{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6e4a19ed-ec8c-56f3-b82c-f9fd8c1a776a","task_key":"all--test--6e4a19ed-ec8c-56f3-b82c-f9fd8c1a776a","task_revision_id":"1","upstream_id":"","short_description":"From an evolutionary perspective, the optimality theory as applied to a given…","config":"all","split":"test","body":"{\"choices\":\"['if the benefits gained from the trait exceed the cost of the trait to the animal performing them, that trait will persist in the genome', 'if the trait reaps the best return for the cost relative to alternative forms of the trait, that trait will win out over the alternative forms', 'beneficial traits are always worth the cost to the organism in energy and physiology, so those traits will persist in the genome', \\\"the relative fitness of an organism must be improved due to a specific trait in order for the trait to remain in a population's gene pool\\\"]\",\"question\":\"From an evolutionary perspective, the optimality theory as applied to a given trait is best represented by the idea that\",\"subject\":\"college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}