{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d1273093-ee58-5d77-98bb-d1ea25d66b70","task_key":"default--test--10785","task_revision_id":"1","upstream_id":"10785","short_description":"What is Pence's main objective in his article \"Will Cloning Harm People?\"","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"[\\\"to use Kant's humanity formulation to show that cloning is morally acceptable\\\", 'to argue for the potential benefits of cloning', 'to use consequentialist arguments to show that cloning is immoral', 'to use virtue ethics to prove that cloning is morally unacceptable', \\\"to use Kant's humanity formulation to show that cloning is immoral\\\", 'to use utilitarian arguments to show that cloning is immoral', 'to object to consequentialist arguments against cloning', 'to argue that cloning is ethically neutral', \\\"to object to Kant's humanity formulation arguments against cloning\\\", 'to use consequentialist arguments to prove that cloning is morally acceptable']\",\"question\":\" What is Pence's main objective in his article \\\"Will Cloning Harm People?\\\"\",\"src\":\"ori_mmlu-moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}