{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e585d938-4839-55a8-a4ee-363b9d7ce01d","task_key":"default--test--3128","task_revision_id":"1","upstream_id":"3128","short_description":"In what ways are studies of twins useful in supplying information about the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Twins studies are used to study the effect of diet on traits.', 'Twins studies only show the effect of heredity on traits.', 'Twins studies are beneficial for examining the role of peer influence on the expression of traits.', 'Twins studies are only useful for determining the impact of childhood diseases on the development of traits.', 'Twins studies are only useful for studying physical traits.', 'Twins studies provide controls for both the effect of environment and heredity on the expression of a trait.', 'Twins studies are primarily used to determine the influence of educational background on traits.', 'Twins studies help in understanding the impact of birth order on the development of traits.', 'Twins studies can isolate the effect of prenatal factors on traits by comparing twins raised apart.', 'Twins studies are used to study the effects of climate on genetic expression in traits.']\",\"question\":\"In what ways are studies of twins useful in supplying information about the relative importance of inheritance and environment in the determination of a given trait?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}