{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f64866b-9d09-51d3-9bb6-a4ac3c2ca809","task_key":"default--test--3506","task_revision_id":"1","upstream_id":"3506","short_description":"What is a transgenic animal? Briefly describe a few ways in which they have…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Transgenic animals are those that have adapted to extreme environments through selective breeding techniques.', 'Transgenic animals are those that have been enhanced with cybernetic implants. Their impact on genetics is limited to speculative fiction.', 'Transgenic animals are those that have been cloned', 'A transgenic animal is one that has undergone a spontaneous mutation that affects its phenotype. They have helped in the study of gene regulation and mutation effects.', 'A transgenic animal is one that has had exogenous DNA artificially introduced into its genome. They have significantly contributed to our understanding of development, tissue-specific gene expression, development and differentiation of the immune system, and disease.', 'Transgenic animals are those that have been subjected to radiation to induce genetic changes. They have been instrumental in studying mutation rates and DNA repair mechanisms.', 'Transgenic animals are those that have naturally evolved new traits', 'A transgenic animal is one that has had its DNA sequence decoded and fully mapped. They have played a role in the identification of genetic markers.', 'Transgenic animals are those that have been genetically modified to express human genes. They have been used to produce pharmaceuticals and to model human diseases.', 'Transgenic animals are those that have been crossbred with other species']\",\"question\":\"What is a transgenic animal? Briefly describe a few ways in which they have impacted the field of genetics.\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}