{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c176fc67-7b97-5e01-bb83-d7d4505a6b96","task_key":"default--test--3083","task_revision_id":"1","upstream_id":"3083","short_description":"Are there any mutations in mice that display behavioral as wellas morphological,…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Mutations in mice are strictly limited to physiological changes with no impact on behavior or morphology.', 'Mice mutations can result in either behavioral or physiological changes, but not both.', 'Mutations in mice only cause morphological abnormalities, not behavioral or physiological ones.', 'All mutations in mice lead to biochemical abnormalities, but never affect behavior or morphology.', 'No, there are no such mutations in mice.', 'Behavioral abnormalities in mice are always due to environmental factors, not mutations.', 'Mice mutations do not affect behavior.', 'Only artificially induced mutations in mice can cause behavioral and physiological abnormalities, not natural ones.', 'Yes, there are mutations in mice that display behavioral as well as morphological, physiological, or biochemical abnormalities.']\",\"question\":\"Are there any mutations in mice that display behavioral as wellas morphological, physiological, or biochemical abnormalities?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}