{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"15082a7e-adcb-57d1-8aba-c9ff69dac321","task_key":"default--test--1199","task_revision_id":"1","upstream_id":"1199","short_description":"What is the meaning of cultural relativism?","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Cultural relativism posits that the application of human rights is relative to the laws in each nation', 'Cultural relativism posits that laws in each nation should validate the existence and practice of human rights', 'Cultural relativism posits that human rights are determined by global consensus', 'Culture relativism posits that human rights have a cultural origin', 'Cultural relativism posits that all cultures are objectively equal in value', 'Cultural relativism posits that human rights should be universally the same in every culture', 'Cultural relativism posits that human rights are determined by religious beliefs', 'Culture relativism posits that human rights apply equally to all without restrictions', 'Cultural relativism posits that the validity of human rights depends on individual beliefs', 'Cultural relativism posits that local culture should validate the existence and practice of all human rights']\",\"question\":\"What is the meaning of cultural relativism?\",\"src\":\"ori_mmlu-international_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}