{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"04c356b8-812d-5351-b5b0-547a8adf1e6f","task_key":"bbeh~5fboolean~5fexpressions--full--04c356b8-812d-5351-b5b0-547a8adf1e6f","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) (not not not (not ((not not (not (not not (not not (not (7 * 5 > 1) or (6 * 6 + 6 * 1 is greater than 2 * 1)) or not not not (True)) or not not not (False)) and (-1 - (-6 / -2) > 3)) or not not not (4 * 10 + 8 * 5 is greater than 8 * -1)) or (True)) and (max(1, 4, -6, -8) - min(1, 4, -6, -8) is greater than 9)) and not not (-7 - (-9 / 4) > 6)) or (The capital of Nepal is Pokhara.)\\n(B) (not not not ((not ((not (not not not ((not not ((max(9, -10, -6, 8) - min(9, -10, -6, 8) <= 6) and (max(1, -2, 9, 5) - min(1, -2, 9, 5) <= 8)) or not not not (9 * 8 <= -9)) and (max(2, -2, 2, 6) - min(2, -2, 2, 6) <= 1)) and not not (False)) or (-9 - (7 / -10) is less than or equal to 6)) and (The capital of Colombia is Bogota.)) and (max(-6, 5, 9, -1) - min(-6, 5, 9, -1) is greater than 4)) or (8 * -4 > 10)) and not not (-5 - (9 / 7) is less than or equal to 5)) and (max(-5, -8, -1, -5) - min(-5, -8, -1, -5) > 10)\\n(C) not not not (not (not not not ((not not (((not (not not (not (not (not not (not (The capital of Nepal is Kathmandu.) or (4 * -9 is less than or equal to 2)) or not not not (-6 * 2 + -6 * 4 > -1 * 9)) or (The capital of Azerbaijan is Ganja.)) and (The capital of Afghanistan is Kabul.)) or not not not (5 - (1 / 2) > 5)) or (True)) or (-1 - (-10 / -7) > -2)) and (-4 * -7 + 4 * 2 is less than or equal to -2 * 3)) or not not not (The capital of Malaysia is Kuala Lumpur.)) and (The capital of Colombia is Medellin.)) and not not (max(8, -6, 4, -2) - min(8, -6, 4, -2) <= 3)) or (False)) and not not (True)\\n(D) not (not not ((not not (-5 * 9 is less than or equal to -2) or not not not (True)) or (not not not (-5 * 7 > -9) and not not (max(5, -3, -2, 9) - min(5, -3, -2, 9) <= 1))) or not not not (not (not not not (max(7, 4, 8, -4) - min(7, 4, 8, -4) is greater than 6) and not not (-4 * 5 > -2)) and (not not (-6 * 3 + -8 * 2 <= 10 * -1) or not not not (-4 * -10 + -4 * 5 > 9 * 3)))) or (((not (True) or (max(-7, -5, -10, 1) - min(-7, -5, -10, 1) is greater than 10)) or (not (False) and (-10 * 3 + -1 * 10 <= 6 * 10))) or (not (not not not (False) and not not (4 * -8 + -3 * -9 <= 4 * 2)) or (not (The capital of Armenia is Yerevan.) and (The capital of Cameroon is Douala.))))\\n(E) (not not not (not ((not not (not (((not not ((not (max(5, -6, -7, 8) - min(5, -6, -7, 8) is greater than 6) and (The capital of Colombia is Bogota.)) and (max(-2, 2, 5, 8) - min(-2, 2, 5, 8) <= 4)) or not not not (True)) or (-3 * 3 is less than or equal to -1)) or (-7 - (-2 / 10) > 10)) or (6 * -6 > -9)) or not not not (-4 - (-3 / -10) is greater than -9)) and (-3 * -8 > 8)) and (3 * 7 <= -4)) and not not (8 - (5 / -7) <= 7)) and (-4 * 10 + -6 * 1 <= -10 * -4)\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}