{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"4710750c-9320-5012-84d7-57d28454351f","task_key":"bbeh~5fboolean~5fexpressions--full--4710750c-9320-5012-84d7-57d28454351f","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) not not not (not (not not not (not (not not (not (not not (not ((True) and (-5 - (4 / 5) is less than or equal to -4)) and (The capital of Denmark is Copenhagen.)) or not not not (-2 - (-5 / 4) <= -2)) or (max(-4, 2, -5, -3) - min(-4, 2, -5, -3) is greater than 1)) or not not not (7 * 10 + 4 * 3 is greater than 10 * -1)) or (-3 * -2 <= 4)) and not not (10 * -4 is less than or equal to -7)) or (The capital of Cameroon is Douala.)) and not not (-2 - (8 / -8) > 3)\\n(B) not not (((not not not (-6 - (4 / 4) > 9) and not not (False)) or (not (1 * 8 + 3 * -7 > -2 * -2) or (True))) and (not not (not (-1 - (-8 / 10) > 3) and (The capital of Colombia is Bogota.)) or not not not (not (True) or (9 - (6 / 6) <= -10)))) or not not not (not not not (not not (not not (-2 - (10 / -2) <= -3) or not not not (True)) or not not not (not (-1 - (7 / -2) > 5) or (-5 - (10 / 6) > 6))) and not not (not (not not not (-3 * 6 + -2 * 10 > 7 * 1) and not not (-7 - (7 / -2) > 8)) or (not not not (The capital of Canada is Toronto.) and not not (-1 * 4 + 8 * -7 <= -2 * 8))))\\n(C) (not (not (((not not not (not (not ((-2 * 9 > 5) or (3 * -8 + 6 * -8 > -10 * 4)) or (5 - (-1 / -6) is greater than -8)) and (9 * -7 > 5)) and not not (max(1, 2, -4, -6) - min(1, 2, -4, -6) <= 2)) and (-2 - (7 / -5) <= -8)) and (The capital of Armenia is Yerevan.)) or (False)) or (3 * -7 + 9 * 10 is greater than -2 * 5)) and (-9 - (9 / -3) > -4)\\n(D) not not not (not ((not (True) and (9 - (2 / 10) is greater than -7)) and ((The capital of Iran is Isfahan.) or (max(-1, -6, 4, -2) - min(-1, -6, 4, -2) is greater than 6))) and (not (not (The capital of India is Mumbai.) or (The capital of Armenia is Yerevan.)) or ((The capital of Turkey is Ankara.) and (-3 - (-7 / -3) is less than or equal to 10)))) and not not ((not (not not not (max(-10, -2, -8, 5) - min(-10, -2, -8, 5) <= 2) and not not (1 * 7 <= -9)) and (not (The capital of India is New Delhi.) or (max(3, -2, 3, 7) - min(3, -2, 3, 7) is greater than 6))) or ((not not not (False) and not not (9 * -9 + 7 * -7 > 9 * 7)) and (not (7 * 2 > -3) and (6 - (-7 / 3) is greater than 5))))\\n(E) not not not (not not not ((not (not not not (not ((not not (not not (not (not (not not (not not not (not (-1 * -10 + 4 * -10 > -9 * -10) and (The capital of Afghanistan is Kabul.)) and not not (The capital of India is Mumbai.)) or not not not (-1 * 5 + 9 * 10 is greater than -7 * 1)) and (False)) and (-7 - (-4 / 6) > 10)) or not not not (True)) or not not not (10 * 9 <= -2)) or (5 * 5 + 3 * 2 <= -7 * -6)) or (-10 - (-3 / 8) > -4)) and not not (max(9, -3, -5, 3) - min(9, -3, -5, 3) is greater than 8)) or (The capital of Iraq is Beirut.)) and (The capital of Gambia is Libreville.)) and not not (-5 - (-9 / -10) > 4)) and not not (False)\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}