{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c322c17-4aac-5585-ae75-4e7513c41f72","task_key":"default--test--3227","task_revision_id":"1","upstream_id":"3227","short_description":"Why did Mendel succeed in discovering the principlesof transmissions of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Mendel had a larger sample size than his contemporaries, which made his results statistically significant', \\\"Mendel's experiments were conducted over a longer period of time than those of other researchers, which gave him more data\\\", 'Mendel studied the transmission of multiple traits at once', \\\"Mendel's success was purely due to luck\\\", 'Mendel collaborated with other leading scientists of his time to develop his theories', \\\"Mendel's success was due to his background in mathematics, allowing him to see patterns that others missed\\\", 'Mendel used advanced technology for his studies', 'Mendel was the first to use the scientific method in the study of heredity', 'Mendel had access to a secret garden with unique plant varieties that no one else had', \\\"Mendel's success was a combination of good experimental technique and luck. He studied one trait at a time, began with pure line plants, and luckily chose traits coded for by genes on different chromosomes.\\\"]\",\"question\":\"Why did Mendel succeed in discovering the principlesof transmissions of hereditary traits, whereas others who had conducted such investigations had failed?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}