{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"813b9a1f-7ae3-5e21-8098-8212ac3cce5b","task_key":"default--test--10880","task_revision_id":"1","upstream_id":"10880","short_description":"Which of the following best describes the fallacy of style over substance?","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"['Rejecting a claim simply because it has been poorly argued, or a fallacy has been made.', 'Making a claim based on evidence that it just as likely to be false as true.', 'Making assumptions about a group based on the characteristics or behavior of a few individuals from that group.', 'Assuming that because two things occur together, they must be causally related.', 'Changing the meaning of a word or phrase from one part of the argument to another.', 'Confusing figurative language with literal language.', 'Assuming that what is true of the whole must also be true of the parts.', 'Reasoning that ideas presented in an appealing manner are correct, regardless of the content of the message.', 'Believing in something simply because it is stated by an authority figure.', 'Using emotionally charged language to create an impression about the subject of a claim, without making an argument that the language fits the subject.']\",\"question\":\"Which of the following best describes the fallacy of style over substance?\",\"src\":\"ori_mmlu-logical_fallacies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}