{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"200ed3a4-57a5-53a8-8f58-72b1fd403f12","task_key":"default--test--10956","task_revision_id":"1","upstream_id":"10956","short_description":"In response to the argument that embryos are not persons because they lack…","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"['the right to life belongs to all living creatures, human or not.', 'the right to life belongs to a human being at all times that he or she exists.', 'only beings capable of experiencing pain should be given the right to life.', 'the right to life is not a relevant concept when discussing embryos.', 'the right to life applies only to beings capable of thought and self-awareness.', 'embryos have potential personhood and therefore should be given the right to life.', 'not all persons have the right to life-for example, a murderer has given up his or her right to life through his or her actions', 'all of the above', 'the right to life does not apply to embryos because they are not independent beings.', 'the right to life is granted at birth and not before.']\",\"question\":\" In response to the argument that embryos are not persons because they lack certain rights that all persons have (such as the right to life), Lee and George argue that\",\"src\":\"ori_mmlu-moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}