{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da02ba39-b53a-5e4a-a740-17e27185bba0","task_key":"default--test--2612","task_revision_id":"1","upstream_id":"2612","short_description":"Citing specific investigations, discuss what the results of twin studieshave…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Identical twins have a lower concordance rate for schizophrenia than fraternal twins', 'Environmental factors are the sole determinants in the development of schizophrenia, with no genetic influence', 'The concordance rate for schizophrenia in fraternal twins is the same as in the general population', 'Schizophrenia is solely transmitted through genetic factors', 'The findings support the view that a predisposition for schizophrenia may exist and it is genetically transmitted', 'Schizophrenia is equally likely to develop in both twins, regardless of zygosity', 'Identical twins have a 100% concordance rate for schizophrenia', 'Identical twins raised apart have no higher concordance for schizophrenia than strangers', 'The concordance rate for schizophrenia in identical twins is the same as in non-twin siblings', 'Fraternal twins have a higher concordance rate for schizophrenia than identical twins']\",\"question\":\"Citing specific investigations, discuss what the results of twin studieshave suggested about the role of heredity in the developmentof schizophrenia.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}