{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc76b458-4926-5bbb-8464-25521a25ce08","task_key":"bbeh~5fsportqa--full--fc76b458-4926-5bbb-8464-25521a25ce08","task_revision_id":"1","upstream_id":"","short_description":"You will be given a main question and two sub-questions. Each question comes…","config":"bbeh_sportqa","split":"full","body":"{\"input\":\"You will be given a main question and two sub-questions. Each question comes with multiple choices you can select from. For each question, select all the correct choices.\\n\\nMain Question:  In a high-intensity football match, when a player is moving fast and suddenly stops, what is the primary physiological response and how does it affect the player's performance?  A) The heart rate decreases and it improves the player's agility. B) The heart rate increases and it improves the player's endurance. C) The heart rate decreases and it reduces the player's agility. D) The heart rate increases and it reduces the player's endurance.\\nSub-Question 1: What is the immediate effect on a player's heart rate during fast movement and sudden stopping in a high-intensity football match?  A) The heart rate decreases significantly. B) The heart rate increases significantly. C) The heart rate remains constant. D) The heart rate fluctuates irregularly.\\nSub-Question 2: How does an increase in heart rate during fast movement and sudden stopping affect a player's performance in a high-intensity football match?  A) It improves the player's agility. B) It improves the player's endurance. C) It reduces the player's agility. D) It reduces the player's endurance.\\n\\nFor each question, provide the answer as a concatenation of the correct choices.\\nSeparate the answers for the questions by comma.\\nFor example, if the correct choices for the main question are A and C, for the first sub-question is D and for the second sub-question are B and D, your final answer must be \\\"AC, D, BD\\\".\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}