{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7ab3b62-bd65-5703-a9d9-343594f88f5c","task_key":"default--test--11039","task_revision_id":"1","upstream_id":"11039","short_description":"What assumption does Pence think people who object to SCNT make when they say…","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"[\\\"The parents are prioritizing their own needs over the child's.\\\", \\\"We can't tell what the motives of the parents are.\\\", 'The parents have ulterior motives.', 'The parents have good motives.', 'The parents are incapable of making decisions for the child.', 'none of the above', \\\"The parents are indifferent to the child's wellbeing.\\\", 'The parents are making an uninformed decision.', 'The parents are exploiting the child for personal gain.', 'The parents have bad motives.']\",\"question\":\" What assumption does Pence think people who object to SCNT make when they say that SCNT is not best for the child?\",\"src\":\"ori_mmlu-moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}