{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbh","formal_name":"BIG-Bench Hard","introduction":"BIG-Bench Hard is the set of 23 BIG-Bench tasks on which models of the time scored below the average human rater. It is best known for showing how much chain-of-thought prompting changes the result.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/suzgunmirac/BIG-Bench-Hard","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97ae2040-b524-56aa-8c2d-db15eb2482b1","task_key":"formal~5ffallacies--main--97ae2040-b524-56aa-8c2d-db15eb2482b1","task_revision_id":"1","upstream_id":"","short_description":"\"Here comes a perfectly valid argument: First of all, being an ingredient of…","config":"formal_fallacies","split":"main","body":"{\"input\":\"\\\"Here comes a perfectly valid argument: First of all, being an ingredient of Hair and Body Wash is sufficient for being an ingredient of Fungus Treatment. Next, every ingredient of Lip Gloss (BCMK) that is an ingredient of Fungus Treatment is also an ingredient of Eye Shadow (Bronze). Plus,everything that is an ingredient of Hair and Body Wash is an ingredient of Lip Gloss (BCMK), too. We may conclude that being an ingredient of Hair and Body Wash is sufficient for being an ingredient of Eye Shadow (Bronze).\\\"\\nIs the argument, given the explicitly stated premises, deductively valid or invalid?\\nOptions:\\n- valid \\n- invalid\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/suzgunmirac/BIG-Bench-Hard","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}