{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f31b8519-94f2-552b-aabc-da3886f44fb3","task_key":"default--test--11060","task_revision_id":"1","upstream_id":"11060","short_description":"Which of the following best describes the fallacy of figure of speech?","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"['Assuming that a particular figure of speech is universally understood.', 'Using an irrelevant figure of speech to divert attention from the argument.', 'A form of loaded language that uses an emotionally charged restatement of the claim in place of support for the claim.', 'Misinterpreting a figure of speech as a logical argument.', 'Misusing a figure of speech in order to make a claim sound more persuasive.', 'Confusing the meaning of a figure of speech with its literal translation.', 'Treating something that exists in the mind as if it was a real object.', 'Using a figure of speech in place of a factual claim.', 'Using emotionally charged language to create an impression about the subject of a claim, without making an argument that the language fits the subject.', 'Confusing figurative language with literal language.']\",\"question\":\"Which of the following best describes the fallacy of figure of speech?\",\"src\":\"ori_mmlu-logical_fallacies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}