{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fef86afb-085e-5a6b-b7ea-9120e01678ea","task_key":"default--test--11014","task_revision_id":"1","upstream_id":"11014","short_description":"Which of the following is the best explanation of the fallacy of loaded…","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"['Using complex or technical language to make an argument seem more credible or sophisticated than it actually is.', \\\"Using language that appeals to the audience's prejudices or biases to win an argument, rather than relying on logical reasoning.\\\", 'Using language that is intentionally misleading or deceptive to convince the audience of a particular point of view.', 'Using language that is overly formal or academic to intimidate the audience and discourage them from questioning the argument.', \\\"Using language and punctuation in a way that a statement can have multiple interpretations, so it's not really clear what is meant.\\\", 'Using language that is overly emotional or dramatic to distract from the lack of substantive evidence or logical reasoning.', 'Using language that is intentionally vague or ambiguous to obscure the truth or mislead the audience.', 'Confusing figurative language with literal language', 'Using emotionally charged language to create an impression about the subject of a claim, without making an argument that the language fits the subject.', 'Referring to an act committed by an opponent in negative terms while referring to the same act committed by the arguer or supporters in favorable terms.']\",\"question\":\"Which of the following is the best explanation of the fallacy of loaded language?\",\"src\":\"ori_mmlu-logical_fallacies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}