{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"16870c56-e18a-5e15-927a-c6cc8b02fc9c","task_key":"all--test--16870c56-e18a-5e15-927a-c6cc8b02fc9c","task_revision_id":"1","upstream_id":"","short_description":"Although mutations occur at a regular and predictable rate, which of the…","config":"all","split":"test","body":"{\"choices\":\"['Some mutations produce alleles that are recessive and may not be expressed.', 'Some undesirable phenotypic traits may be prevented from reproducing.', 'Some mutations cause such drastic phenotypic changes that they are removed from the gene pool.', 'The predictable rate of mutation results in ongoing variability in a gene pool.']\",\"question\":\"Although mutations occur at a regular and predictable rate, which of the following statements is the LEAST likely reason the frequency of mutation appears to be low?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}