{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"4d7b3fcd-24ab-5eb9-ac69-dc6450dca02f","task_key":"bbeh~5fboolean~5fexpressions--full--4d7b3fcd-24ab-5eb9-ac69-dc6450dca02f","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) not not not ((not not (not (-6 - (-10 / 9) <= -8) and (-4 * 9 + 9 * -5 <= -2 * 9)) or not not not (not not not (True) and not not (-8 * 3 is less than or equal to 7))) or (not not (not (-2 * -9 <= 8) or (max(-5, -4, 4, 9) - min(-5, -4, 4, 9) <= 10)) or not not not (not (6 * -3 + -1 * -4 is less than or equal to -6 * 4) and (False)))) and not not (not (not (not not not (-5 - (8 / -8) is less than or equal to -1) and not not (2 - (-5 / 1) <= -1)) and (not (-3 - (2 / 5) > 7) and (7 * -5 > -1))) or (not not not (not not (-3 * 5 + -6 * -1 is less than or equal to 6 * -7) or not not not (-5 * -6 > 9)) and not not (not not not (10 * -8 + 8 * -9 <= 9 * 10) and not not (False))))\\n(B) not ((not not (not (not not not ((not (not ((not not (not not (not not (not (not (6 * -8 + 10 * 10 is less than or equal to 5 * -3) or (max(9, -4, -1, 4) - min(9, -4, -1, 4) is greater than 1)) and (9 * 5 > 6)) or not not not (False)) or not not not (-9 * 7 + 2 * -3 <= -6 * 2)) or not not not (-4 - (-3 / 1) <= -2)) and (-8 * 6 + -7 * -5 <= 5 * 10)) and (10 * -1 + 4 * -8 <= -10 * -7)) or (The capital of Belarus is Grodno.)) or (True)) and not not (-4 * -4 <= -5)) and (False)) or not not not (5 * -6 > -9)) and (9 - (4 / -6) <= 2)) or (The capital of Iraq is Beirut.)\\n(C) not (not not (not (not (not not not (not not ((not not not (not not not (not (not ((-8 - (-6 / -10) is less than or equal to 4) and (1 * -5 > 10)) or (True)) or (True)) and not not (5 - (4 / -2) <= -8)) and not not (8 - (-8 / -1) is less than or equal to 6)) or (True)) or not not not (max(8, -10, -3, 9) - min(8, -10, -3, 9) <= 10)) and not not (The capital of Jordan is Amman.)) and (1 * -1 is less than or equal to 6)) and (True)) or not not not (-10 * -2 + -4 * -9 is less than or equal to -9 * 8)) or (3 * 8 <= -3)\\n(D) (not ((not (max(8, 6, 6, 10) - min(8, 6, 6, 10) is greater than 3) and (8 - (10 / 2) is less than or equal to 6)) or (not not (False) or not not not (-10 - (-1 / -8) > -7))) and (not not (not (3 * 5 > 10) and (True)) or not not not (not (-5 * -6 + -9 * 4 > -3 * -6) or (True)))) or (not (not (not (8 * 6 <= -2) and (-1 * 7 + 8 * 5 is greater than 8 * -7)) and ((max(7, 10, -2, -3) - min(7, 10, -2, -3) <= 1) and (-8 * 3 + -4 * 8 <= 8 * 9))) and ((not not (False) or not not not (True)) and ((2 * 4 + 10 * 1 is greater than 4 * -2) or (The capital of the Nigeria is Lagos.))))\\n(E) not not (not not (not not not (not (5 * 10 + -3 * -9 is greater than 2 * 2) or (max(-4, 4, -5, 7) - min(-4, 4, -5, 7) is greater than 4)) and not not (not not (1 * -5 + -8 * -2 is greater than 9 * -2) or not not not (-8 * -9 + -4 * 1 is less than or equal to -8 * 7))) or not not not (not not (not not (7 * 8 + -10 * -9 is less than or equal to -8 * -6) or not not not (False)) or not not not ((5 * -3 + -9 * -7 is less than or equal to -7 * 4) and (-5 - (-2 / -3) > -3)))) or not not not (not not (not not not (not not (The capital of Colombia is Bogota.) or not not not (True)) and not not (not not (-3 - (4 / 9) is less than or equal to 9) or not not not (-4 - (-6 / -1) > 6))) or not not not ((not not not (The capital of Turkey is Istanbul.) and not not (The capital of Afghanistan is Kabul.)) and (not (2 - (6 / -3) <= -6) and (The capital of Norway is Bergen.))))\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}