{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8a1b9168-4c92-5a73-9a74-9a4a0dda379f","task_key":"default--test--3347","task_revision_id":"1","upstream_id":"3347","short_description":"Explain how the codon for phenylalanine was discovered.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The codon AUG, which also signals the start of protein synthesis, codes for phenylalanine', 'The triplet GGA was identified as the codon for phenylalanine through early genetic experiments', 'The codon CCC corresponds to phenylalanine', 'The codon UUU is the sequence of bases which causes phenylalanine to be placed in the polypeptide chain', 'Phenylalanine is coded by the codon GGG', 'The codon UUA was incorrectly thought to code for phenylalanine before further research clarified the correct codon', 'The codon AAG signals for the addition of phenylalanine to the polypeptide chain', 'The codon AGU was found to code for serine, but was initially believed to code for phenylalanine', 'The codon UUC was the first discovered sequence to code for phenylalanine', 'The codon AAA codes for phenylalanine']\",\"question\":\"Explain how the codon for phenylalanine was discovered.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}