{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"73283b8e-337d-51cf-b803-96b26f150019","task_key":"bbeh~5fboolean~5fexpressions--full--73283b8e-337d-51cf-b803-96b26f150019","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) not not not (not not (not (3 * 7 + -6 * 1 is less than or equal to 1 * 7) and (-5 - (-2 / -6) is less than or equal to 2)) or not not not (not not (-1 - (-4 / -3) is greater than -4) or not not not (False))) and not not (not (not not not (4 - (-1 / -7) is greater than -6) and not not (-6 * -8 + 1 * 7 is greater than 7 * 4)) or (not (True) and (-5 * -6 + -7 * -8 is less than or equal to -8 * 7)))\\n(B) not not not (not not (not not (not not not (not (not ((max(-6, -10, -3, 3) - min(-6, -10, -3, 3) is greater than 8) and (1 * -2 + -1 * 4 > 5 * 6)) or (-2 * 2 + -3 * -7 is greater than 10 * -7)) and (-3 - (4 / -9) > 1)) and not not (6 * 9 + 9 * 9 is less than or equal to 1 * -6)) or not not not (5 * 9 <= 8)) or not not not (4 * 2 > -8)) and not not (-8 * 4 + -10 * 8 <= 8 * -6)\\n(C) not not not (not (not not not (not (not not (not ((not not (not (not (not ((The capital of Norway is Bergen.) or (-4 * -4 <= -6)) or (8 * 8 <= -1)) and (True)) and (7 * 8 + -6 * 7 <= 6 * 3)) or not not not (max(2, 8, -5, -4) - min(2, 8, -5, -4) <= 5)) and (-10 * -8 + 10 * 1 is less than or equal to 1 * 8)) and (max(-3, -1, 8, 8) - min(-3, -1, 8, 8) <= 8)) or not not not (max(1, 9, -4, -2) - min(1, 9, -4, -2) is greater than 6)) or (True)) and not not (2 * -4 > 8)) or (-4 - (8 / -9) is greater than -9)) and not not (6 * 8 <= -9)\\n(D) not (not not not ((not not not (not not (not not (not not not ((not not not (-4 * 6 + 1 * -2 > -1 * -7) and not not (3 * -10 > -5)) or (True)) and not not (False)) or not not not (The capital of Turkey is Ankara.)) or not not not (True)) and not not (The capital of Azerbaijan is Baku.)) and (-2 * -4 > 9)) and not not (-3 - (8 / -2) <= -2)) and (max(-8, 4, 9, -8) - min(-8, 4, 9, -8) <= 4)\\n(E) not (not (not not ((not not (not not not (not not not (not (not (not (-10 * -5 <= 10) and (The capital of Azerbaijan is Ganja.)) or (max(4, 10, 8, -7) - min(4, 10, 8, -7) is greater than 10)) or (7 * -4 > 1)) and not not (max(9, -4, 10, -2) - min(9, -4, 10, -2) <= 10)) and not not (-10 - (-6 / 9) > -6)) or not not not (-2 * 8 > 1)) or (6 * -6 + 10 * 7 is less than or equal to -3 * 1)) or not not not (The capital of the Nigeria is Lagos.)) and (5 * 9 + -7 * -2 is greater than -5 * -7)) or (-3 * -4 + -6 * -6 is less than or equal to -10 * 2)\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}