{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36462234-9e6b-5f54-b803-ee92bac084c2","task_key":"bbeh~5fsportqa--full--36462234-9e6b-5f54-b803-ee92bac084c2","task_revision_id":"1","upstream_id":"","short_description":"You will be given a main question and two sub-questions. Each question comes…","config":"bbeh_sportqa","split":"full","body":"{\"input\":\"You will be given a main question and two sub-questions. Each question comes with multiple choices you can select from. For each question, select all the correct choices.\\n\\nMain Question:   Why would a volleyball team use a \\\"swing blocking\\\" strategy over a \\\"read blocking\\\" strategy during a defensive play?  A) Swing blocking provides a faster and more dynamic movement to cover larger areas of the net. B) Swing blocking allows players to reach higher, providing better chances to deflect the ball. C) Read blocking requires less physical exertion and could be beneficial in long matches. D) Read blocking allows blockers to react to the attacker's movements and adjust their positions accordingly.   \\nSub-Question 1:   Why might a team choose a \\\"read blocking\\\" strategy despite its potential limitations in speed and reach?  A) Read blocking allows blockers to adapt to the opponent's strategy and adjust their positions accordingly. B) Read blocking is less physically demanding and could conserve players' energy for longer matches. C) Swing blocking can cover larger areas of the net, making it more effective against diverse attacking strategies. D) Swing blocking enables blockers to reach higher, improving the chances of deflecting the ball.   \\nSub-Question 2:   Why would a team adopt a double block strategy during a game, considering it leaves other areas of the court more vulnerable?  A) A double block can intimidate the attacker and force them to change their attack strategy. B) A double block can effectively cover a larger area of the net, increasing the chances of blocking the ball. C) Using a double block strategy can leave large areas of the court unguarded, potentially leading to easy points for the opponent. D) A double block strategy requires more coordination and communication among players, which could be challenging for less experienced teams.\\n\\nFor each question, provide the answer as a concatenation of the correct choices.\\nSeparate the answers for the questions by comma.\\nFor example, if the correct choices for the main question are A and C, for the first sub-question is D and for the second sub-question are B and D, your final answer must be \\\"AC, D, BD\\\".\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}