{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6fe8ef47-66f9-57e2-9972-6fa77dd18d90","task_key":"default--test--2716","task_revision_id":"1","upstream_id":"2716","short_description":"Of the following, the best predictor of a child’s post-divorce adjustment during…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['level of involvement of the non-custodial parent', 'age of the child at the time of the divorce', 'degree of continued conflict between the parents after the divorce', 'degree of hostility during the divorce process', 'residence of the child with the preferred parent', \\\"child's academic performance before the divorce\\\", 'financial status of the parents after the divorce', 'withdrawal of the more disturbed parent', 'level of support from extended family', \\\"frequency of the child's contact with friends after the divorce\\\"]\",\"question\":\"Of the following, the best predictor of a child’s post-divorce adjustment during the 2 years following divorce is the\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}