{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbh","formal_name":"BIG-Bench Hard","introduction":"BIG-Bench Hard is the set of 23 BIG-Bench tasks on which models of the time scored below the average human rater. It is best known for showing how much chain-of-thought prompting changes the result.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/suzgunmirac/BIG-Bench-Hard","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7063de19-744b-58a6-a5d5-95be407f4146","task_key":"formal~5ffallacies--main--7063de19-744b-58a6-a5d5-95be407f4146","task_revision_id":"1","upstream_id":"","short_description":"\"Is Fred a fan of Liverpool? Are supporters of Real Madrid devotees of PSG? In…","config":"formal_fallacies","split":"main","body":"{\"input\":\"\\\"Is Fred a fan of Liverpool? Are supporters of Real Madrid devotees of PSG? In European football, it is sometimes difficult to keep track of the mutual admiration and dislike. The following argument seeks to clarify some such relations: First premise: Every opponent to AS Roma is a backer of Hertha BSC Berlin or a fan of AC Sparta Praha or not a fan of FCSB. Second premise: No fan of FCSB is an expert of FK Sūduva. Third premise: Every fan of AC Sparta Praha is an expert of FK Sūduva. Fourth premise: Being an expert of FK Sūduva is necessary for being a backer of Hertha BSC Berlin. Hence, being an expert of FK Sūduva is necessary for being an opponent to AS Roma.\\\"\\nIs the argument, given the explicitly stated premises, deductively valid or invalid?\\nOptions:\\n- valid \\n- invalid\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/suzgunmirac/BIG-Bench-Hard","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}