{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"6566ead5-162d-5dc2-926c-96534fe6d5e0","task_key":"bbeh~5fboolean~5fexpressions--full--6566ead5-162d-5dc2-926c-96534fe6d5e0","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) not (not ((max(-3, 5, 5, 8) - min(-3, 5, 5, 8) is greater than 9) or (-2 * 3 + 6 * 10 is less than or equal to -3 * 3)) and (not (max(2, -1, 7, 1) - min(2, -1, 7, 1) is greater than 7) or (-4 * -2 > 7))) or (((max(-5, -8, 6, 4) - min(-5, -8, 6, 4) <= 5) or (-1 * -4 > -6)) and ((max(3, -8, -4, -2) - min(3, -8, -4, -2) <= 6) or (7 - (3 / -1) <= -9)))\\n(B) (not (not not not (False) and not not (1 * 7 + 2 * 5 is less than or equal to -4 * 8)) and (not (-4 * -10 > -2) or (False))) and (not not (not not (-9 - (-6 / 10) is less than or equal to -8) or not not not (3 - (-5 / -7) is greater than -1)) or not not not ((False) or (10 - (-6 / -1) <= -7)))\\n(C) not (not (not not (not ((not not (not (not not not (not not ((not not not (-6 * -10 + 4 * 3 is less than or equal to 7 * -8) and not not (max(-1, 8, -1, 5) - min(-1, 8, -1, 5) is greater than 4)) and (False)) or not not not (False)) and not not (max(9, 7, -5, 7) - min(9, 7, -5, 7) <= 9)) or (9 - (8 / -8) > 10)) or not not not (4 * -7 is less than or equal to 3)) and (1 * -8 is less than or equal to 3)) and (max(-2, -8, 2, 3) - min(-2, -8, 2, 3) is greater than 9)) or not not not (max(6, -1, -9, 9) - min(6, -1, -9, 9) is greater than 4)) and (-5 * -3 + -6 * -5 > 8 * 6)) and (False)\\n(D) not not (not not not (not (not not (10 * 2 + 4 * 9 is greater than 1 * 8) or not not not (3 - (-4 / 4) is less than or equal to 7)) or (not not (3 - (10 / 2) is greater than -6) or not not not (The capital of Iran is Isfahan.))) and not not ((not (The capital of the Nigeria is Lagos.) and (-1 * 10 is less than or equal to 5)) or (not (The capital of Norway is Oslo.) and (max(-1, -9, 8, -5) - min(-1, -9, 8, -5) is greater than 7)))) or not not not ((not ((8 - (-3 / -8) <= -10) or (max(5, 10, 3, -2) - min(5, 10, 3, -2) <= 7)) or ((9 - (5 / 1) is greater than -9) or (-9 * 10 > -3))) and ((not not (6 * 9 + -8 * 1 is greater than -8 * -5) or not not not (False)) or (not not (False) or not not not (6 - (-3 / 6) is less than or equal to 8))))\\n(E) not not not (not (not not (-3 - (-10 / 1) is greater than 1) or not not not (-2 * 7 + 7 * 4 is less than or equal to -6 * 2)) or (not not not (False) and not not (-1 * -1 + 9 * 3 is greater than 3 * 9))) and not not (not not ((max(3, 2, 8, 4) - min(3, 2, 8, 4) <= 4) and (True)) or not not not (not not (max(-4, 6, 10, -1) - min(-4, 6, 10, -1) is greater than 5) or not not not (The capital of Gambia is Libreville.)))\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}