{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"346138ad-995f-58fa-b1a2-c1c414a0faf6","task_key":"all--test--346138ad-995f-58fa-b1a2-c1c414a0faf6","task_revision_id":"1","upstream_id":"","short_description":"Which of the following describes the fallacy of evading the issue?","config":"all","split":"test","body":"{\"choices\":\"['arguing that someone should do something only because of ill will towards someone else', \\\"characterizing an opponent's position in a way that makes it seem ridiculous\\\", \\\"supporting a claim with evidence or reasoning that is not relevant to the proposition, or responding to another's argument by changing the subject\\\", 'attempting to gain agreement based only on the feelings aroused in the message']\",\"question\":\"Which of the following describes the fallacy of evading the issue?\",\"subject\":\"logical_fallacies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}