{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"4d52e93e-248f-5274-9cba-a4efbd3b5413","task_key":"bbeh~5fboolean~5fexpressions--full--4d52e93e-248f-5274-9cba-a4efbd3b5413","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) not (not not ((2 * 10 + -4 * 9 <= 5 * 2) and (max(-3, -6, 9, 1) - min(-3, -6, 9, 1) <= 7)) or not not not (not (-9 * 8 + 7 * -4 <= 6 * -3) or (False))) and (not not not ((True) or (2 * 5 + 1 * -1 is greater than -8 * 2)) and not not (not (max(5, -4, -4, -1) - min(5, -4, -4, -1) <= 2) or (The capital of Cameroon is Yaounde.)))\\n(B) not ((not (not (not (not ((True) or (8 * 9 > 2)) and (False)) or (False)) and (max(-6, -4, -6, 1) - min(-6, -4, -6, 1) <= 8)) or (8 - (5 / 8) <= 2)) and (-6 * -8 + -5 * 6 is less than or equal to -1 * -6)) or (-8 * 9 + 7 * -2 <= -4 * 8)\\n(C) not ((not ((-5 - (-4 / -10) > 10) and (-2 * -5 + -8 * -2 is less than or equal to -2 * -10)) or (not not not (False) and not not (False))) or (not not not (not not (-4 * 1 + 5 * 6 is less than or equal to -1 * -8) or not not not (max(-3, 10, -1, -1) - min(-3, 10, -1, -1) <= 3)) and not not (not (5 - (-1 / 2) <= 5) or (max(2, 5, 3, -7) - min(2, 5, 3, -7) <= 4)))) or (not (((The capital of UAE is Dubai.) and (max(-6, -6, 9, 4) - min(-6, -6, 9, 4) <= 8)) or ((The capital of Armenia is Yerevan.) and (True))) or (not (not not not (8 * -8 is less than or equal to -9) and not not (True)) and ((The capital of Denmark is Aarhus.) or (2 * 2 + 9 * -2 is less than or equal to 10 * -8))))\\n(D) not not not (not not (not not (10 * -7 + -10 * -6 is less than or equal to -6 * 8) or not not not (5 * 7 + -8 * -5 is less than or equal to 8 * -8)) or not not not ((The capital of Germany is Berlin.) and (The capital of Cameroon is Yaounde.))) and not not (((6 - (-6 / -6) is greater than -6) or (7 * -4 > 5)) or (not (True) and (max(1, -9, 7, -2) - min(1, -9, 7, -2) <= 5)))\\n(E) not not not (not not (((not (not not not (not (not not (not (max(2, -1, 10, 5) - min(2, -1, 10, 5) <= 5) and (max(-2, 2, 1, -1) - min(-2, 2, 1, -1) > 9)) or not not not (The capital of Norway is Bergen.)) and (max(-5, 1, -9, 4) - min(-5, 1, -9, 4) is greater than 5)) and not not (False)) and (-3 * 9 is less than or equal to 7)) and (-1 * 3 > 1)) and (2 * -8 + -3 * -3 > -1 * 4)) or not not not (-4 * 1 + 1 * -7 > 1 * -9)) and not not (-3 * 3 is less than or equal to -5)\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}