{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c6c70b3-afaa-511d-be8b-db818943edc3","task_key":"default--test--10963","task_revision_id":"1","upstream_id":"10963","short_description":"Which of the following is not an objection Pence gives to the argument that SCNT…","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"['The potential for genetic abnormalities is not a valid argument against SCNT.', 'The expectations people will place on SCNT individuals could be no worse than normal expectations of children created sexually.', 'The argument falsely assumes that SCNT individuals would have a lesser quality of life.', 'The argument assumes genetic determinism or genetic reductionism.', 'The argument fails to take into account the rights and autonomy of the parents.', 'The argument neglects the emotional and psychological well-being of the child.', \\\"People's prejudicial attitudes are likely to change.\\\", 'SCNT could potentially lead to advancements in medical research and treatment.', 'The argument ignores the potential benefits of SCNT to society.', \\\"If people's prejudicial attitudes do not change, then we should not allow SCNT.\\\"]\",\"question\":\" Which of the following is not an objection Pence gives to the argument that SCNT is not best for the child?\",\"src\":\"ori_mmlu-moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}