{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c593a074-8de1-517b-8325-f1f086e8d869","task_key":"all--test--c593a074-8de1-517b-8325-f1f086e8d869","task_revision_id":"1","upstream_id":"","short_description":"How can several different proteins be produced from the same gene?","config":"all","split":"test","body":"{\"choices\":\"['By selective transcription of different parts of the DNA in the gene.', 'By doubling or tripling the length of the mRNA molecule produced from the primary transcript.', 'The primary transcripts of many genes can be spliced in various ways to produce different mRNAs, a process known as alternative RNA splicing.', 'By splicing of the mRNA molecule after it has been formed from the primary transcript.']\",\"question\":\"How can several different proteins be produced from the same gene?\",\"subject\":\"college_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}