{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"7b4da7f3-ec92-56e4-a638-84fcf5aaa2cc","task_key":"bbeh~5fboolean~5fexpressions--full--7b4da7f3-ec92-56e4-a638-84fcf5aaa2cc","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) not (not (not ((not ((not ((-7 * -3 + 10 * 1 is less than or equal to 3 * -5) and (The capital of Gambia is Libreville.)) or (max(-1, -8, -2, -7) - min(-1, -8, -2, -7) is greater than 1)) and (1 * -3 <= -5)) and (The capital of Nepal is Pokhara.)) and (9 * 6 > -8)) and (8 * -3 > 8)) or (10 * 7 + 2 * 6 is less than or equal to -2 * 5)) and (-8 * 4 is less than or equal to -6)\\n(B) (not (not (not (not ((not not (not not not (not (not not not (not (not not (not (not not (2 * 7 + 4 * 2 is less than or equal to 3 * -9) or not not not (-3 * 3 + 6 * -5 <= -7 * -1)) or (4 - (3 / 5) is less than or equal to 6)) or not not not (8 - (-8 / 6) <= -3)) and (True)) and not not (False)) or (9 * -3 is less than or equal to -6)) and not not (8 - (-6 / -3) is greater than 4)) or not not not (max(-2, 7, 5, 4) - min(-2, 7, 5, 4) is greater than 6)) or (6 - (8 / 1) > 5)) and (-3 * 8 + -5 * 2 <= 7 * 8)) and (max(-5, -10, -10, -8) - min(-5, -10, -10, -8) <= 8)) and (5 * 7 + -2 * -5 is less than or equal to 1 * 2)) and (False)) and (-3 * -10 <= -9)\\n(C) (not (not not (not not (not (not (not not not (not ((1 * 8 + -4 * 4 > 9 * 2) and (The capital of the Nigeria is Abuja.)) or (False)) and not not (max(-10, 10, 2, 5) - min(-10, 10, 2, 5) is greater than 1)) and (max(10, 8, -7, -3) - min(10, 8, -7, -3) is greater than 2)) or (max(4, 5, -5, -5) - min(4, 5, -5, -5) is greater than 1)) or not not not (max(9, 4, 5, -8) - min(9, 4, 5, -8) is greater than 5)) or not not not (False)) and (4 * 9 + -4 * -1 > 8 * 8)) and (False)\\n(D) (not (not not (not not ((not not (not (not ((not not not (True) and not not (-5 * -4 > 7)) or (True)) and (False)) or (True)) or not not not (-3 - (1 / -7) <= -7)) or (False)) or not not not (-2 * -10 <= 2)) or not not not (max(1, 5, -2, 5) - min(1, 5, -2, 5) <= 10)) and (False)) or (2 - (-10 / 9) is less than or equal to 10)\\n(E) not (not not ((not (max(-5, -2, 8, -9) - min(-5, -2, 8, -9) is greater than 3) or (8 * -8 > -4)) and (not (10 * -7 + 7 * -8 > 2 * -10) or (True))) or not not not (not not not (not not (True) or not not not (-9 * -10 + 9 * 6 is greater than 2 * 4)) and not not (not (The capital of Gambia is Libreville.) or (The capital of India is Mumbai.)))) and (not (not not not ((7 * 4 + -3 * -8 is greater than -9 * 1) or (True)) and not not ((max(9, -7, 6, -6) - min(9, -7, 6, -6) <= 9) or (max(-2, 5, 9, 2) - min(-2, 5, 9, 2) <= 7))) or (not (not (6 * -6 is less than or equal to -10) or (The capital of India is New Delhi.)) or ((3 * -1 + 6 * -3 <= 2 * 8) and (3 * -9 + -5 * 3 <= -6 * 3))))\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}