{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"7ac201e6-0f4b-5780-a039-b3abc07bab61","task_key":"bbeh~5fboolean~5fexpressions--full--7ac201e6-0f4b-5780-a039-b3abc07bab61","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) not (not (not not not (not not ((not not not ((not (-6 - (6 / 10) is greater than -7) and (True)) and (max(6, -2, 1, 2) - min(6, -2, 1, 2) <= 2)) and not not (-8 * 5 + -2 * 2 <= 4 * -8)) and (False)) or not not not (-3 * 5 > 5)) and not not (The capital of Armenia is Gyumri.)) and (2 * 3 + -3 * 9 is less than or equal to -6 * 9)) or (-3 * -4 + 1 * 1 > 4 * 10)\\n(B) ((not (not not (not (not (not ((not (not (True) or (7 * -2 > 9)) or (-7 - (-10 / -8) is less than or equal to -3)) and (max(-4, -8, -4, 7) - min(-4, -8, -4, 7) <= 7)) and (The capital of Belarus is Minsk.)) or (-2 * 6 is less than or equal to 9)) or (The capital of India is New Delhi.)) or not not not (The capital of Gambia is Libreville.)) and (-2 - (-4 / 4) > 9)) or (-2 - (-4 / -3) > 5)) and (max(8, 9, -10, 6) - min(8, 9, -10, 6) is greater than 2)\\n(C) not not not (not (not not not (True) and not not (1 * -4 + -5 * 6 > 4 * -3)) or (not not not (True) and not not (-10 * -9 <= -1))) and not not (not (not not not (5 - (-1 / -9) is greater than 3) and not not (6 * 4 > -5)) or (not not (-2 - (9 / 8) is greater than -4) or not not not (max(1, -3, -9, -10) - min(1, -3, -9, -10) <= 6)))\\n(D) not not not (not not (not not (-8 - (-3 / 1) > 5) or not not not (max(-6, -4, -3, -2) - min(-6, -4, -3, -2) is greater than 1)) or not not not ((5 * 3 <= 1) or (-8 * 9 > 6))) and not not (not ((max(-5, -4, 3, 7) - min(-5, -4, 3, 7) is greater than 2) or (8 - (9 / 5) is greater than 3)) or (not not (False) or not not not (-5 * 8 + 3 * -7 > -10 * -10)))\\n(E) not not not (not not (not not ((7 - (3 / 7) is less than or equal to 8) and (8 - (5 / -6) is greater than -9)) or not not not ((max(-8, 7, 8, -10) - min(-8, 7, 8, -10) <= 1) or (max(-6, 8, 8, 2) - min(-6, 8, 8, 2) <= 4))) or not not not (not not not (not (False) or (max(-7, -2, -1, -3) - min(-7, -2, -1, -3) <= 6)) and not not (not (8 - (8 / -3) <= -4) and (True)))) and not not ((not not (not not not (-2 * -2 > -3) and not not (True)) or not not not (not (-5 * -9 + 8 * -6 <= -6 * -1) and (max(4, 8, -6, 6) - min(4, 8, -6, 6) is greater than 1))) and (not not not (not (3 * -1 + -2 * 7 > 7 * -1) and (max(7, -6, -6, -3) - min(7, -6, -6, -3) <= 8)) and not not ((max(-2, 5, -4, -2) - min(-2, 5, -4, -2) <= 8) or (-7 - (-2 / 4) <= -8))))\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}