{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92a6abb0-8deb-54eb-b17e-6c7247f9ba2d","task_key":"default--test--6134","task_revision_id":"1","upstream_id":"6134","short_description":"Which of the following statements about protein synthesis is correct?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Both strands of DNA are transcribed to form mRNA.', 'The RNA formed by transcription of DNA directly forms the protein.', 'The mRNA formed by transcription of a region of DNA only contains information for the protein to be synthesised.', 'The RNA formed by transcription of DNA undergoes no modifications to form mRNA.', 'The RNA formed by transcription of DNA undergoes splicing and further modifications to form mRNA.', 'All proteins are synthesized directly from the mRNA without any modifications.', 'All the information in DNA codes for proteins', 'Only one strand of DNA is transcribed to form rRNA.', 'Proteins are formed directly from DNA without the need for RNA.', 'The mRNA formed by transcription of a region of DNA contains information for multiple proteins.']\",\"question\":\"Which of the following statements about protein synthesis is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}