{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"カテゴリ別の難しい課題を通じて、言語モデルの推論能力を評価するベンチマークです。fullとminiの配布があり、この取り込みではfullの論理式カテゴリ200問を扱います。\n\nBIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains 200 Boolean-expression questions from the full distribution.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"noindex"},"task_id":"56b22774-0ef3-50ae-9cf0-4e3ae4a59817","task_key":"bbeh~5fboolean~5fexpressions--full--56b22774-0ef3-50ae-9cf0-4e3ae4a59817","task_revision_id":"2","upstream_id":"","short_description":"From the following five expressions, only one evaluates to true. Which one is…","config":"bbeh_boolean_expressions","split":"full","body":"{\"input\":\"From the following five expressions, only one evaluates to true. Which one is it?\\n\\n(A) not (not ((not not (The capital of Afghanistan is Kandahar.) or not not not (3 * 2 + 7 * 1 is less than or equal to 10 * -1)) and ((True) and (The capital of the Nigeria is Lagos.))) or (not not not (not not not (-6 - (-4 / -9) > -5) and not not (False)) and not not (not (True) or (False)))) and (not (not not (not not not (6 * 2 + -9 * -5 is less than or equal to -7 * 6) and not not (6 * 7 <= -10)) or not not not ((-9 * -8 <= 9) or (-1 - (8 / 9) is less than or equal to 7))) and (not (not (-8 - (1 / -9) > 5) and (-8 * 2 + -10 * -6 <= 10 * 10)) and (not not not (-4 - (-7 / -2) > -1) and not not (-10 * -5 <= -1))))\\n(B) not not not (not (not not (True) or not not not (The capital of Norway is Oslo.)) and (not not (10 * 8 + 2 * -8 is less than or equal to 9 * -5) or not not not (10 * 10 > 3))) and not not (not (not (The capital of Iran is Isfahan.) or (-5 * 3 > -2)) and (not (3 - (-10 / -4) is less than or equal to 5) and (max(-1, 7, 4, -3) - min(-1, 7, 4, -3) <= 7)))\\n(C) not ((not (False) and (-10 - (4 / 4) is less than or equal to 10)) or (not (False) or (The capital of Turkey is Istanbul.))) and (not not not ((-2 * -3 + -4 * 6 <= 6 * 2) or (max(-7, 10, 6, -6) - min(-7, 10, 6, -6) <= 1)) and not not (not (-9 * -8 + 4 * -3 is less than or equal to 3 * 6) or (6 * 3 + -7 * -2 is less than or equal to 2 * 9)))\\n(D) not ((not (-9 - (6 / 10) > -7) or (-2 * 3 + 4 * -1 is greater than -4 * 8)) and (not (-5 * -4 <= 10) and (5 * -1 is less than or equal to -3))) or (not not ((True) and (True)) or not not not (not (2 * 10 + 5 * -9 > 9 * -2) or (4 * 10 + 1 * -10 > 7 * 8)))\\n(E) (not ((max(-9, 10, 7, -2) - min(-9, 10, 7, -2) <= 6) and (True)) and (not not not (False) and not not (max(7, -7, 4, -5) - min(7, -7, 4, -5) <= 3))) or (not (not (6 - (5 / 9) is greater than 1) or (5 - (-4 / 3) is greater than -5)) and (not (The capital of Turkey is Istanbul.) and (-7 - (7 / 9) > 6)))\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}