{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3ddb41c-68a6-5ef7-8998-77522c4399c3","task_key":"default--test--2907","task_revision_id":"1","upstream_id":"2907","short_description":"In what ways are human beings not favorable for studies of inheritance?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Inability to conduct controlled breeding experiments', 'Human beings can control their breeding patterns', 'Humans have identical genetic makeup', 'All human traits are polygenic and not influenced by environment', 'Complex genes interaction, environmental control, long lifespan, small family sizes, ethical issues', 'Short lifespan prevents long-term study', 'Lack of genetic variation', 'Too many genes to analyze accurately', 'Humans are too complex to study', 'Human genes are not inheritable']\",\"question\":\"In what ways are human beings not favorable for studies of inheritance?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}