{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f58f5727-1d80-59d3-80ce-49ce2a095648","task_key":"bbeh~5fsportqa--full--f58f5727-1d80-59d3-80ce-49ce2a095648","task_revision_id":"1","upstream_id":"","short_description":"You will be given a main question and two sub-questions. Each question comes…","config":"bbeh_sportqa","split":"full","body":"{\"input\":\"You will be given a main question and two sub-questions. Each question comes with multiple choices you can select from. For each question, select all the correct choices.\\n\\nMain Question:  How can a volleyball player effectively block an opponent's spike, considering both the technical aspects of blocking and the strategic positioning on the court?  A) By jumping straight up and down, keeping the hands wide apart and aiming to touch the ball with the fingertips B) By maintaining a position close to the net and timing the jump to coincide with the opponent's spike, while keeping the hands close together to cover a specific area of the net C) By positioning themselves in a way that they can react quickly to the direction of the spike, while keeping their hands high and wide to cover a larger area of the net D) By timing their jump to block the ball before it crosses the net, while positioning themselves based on the opponent's body language and approach to the net   \\nSub-Question 1:  What are some of the key technical aspects a player needs to consider to effectively block an opponent's spike in volleyball? A) The player needs to jump straight up and down, keeping their hands wide apart B) The player needs to time their jump to coincide with the opponent's spike, and aim to touch the ball before it crosses the net C) The player needs to keep their hands close together to cover a specific area of the net D) The player needs to keep their hands high and wide to cover a larger area of the net   \\nSub-Question 2:  What are some strategic positioning strategies a player can use to effectively block an opponent's spike in volleyball? A) The player should always maintain a position close to the net B) The player should position themselves based on the opponent's body language and approach to the net C) The player should position themselves in a way that they can react quickly to the direction of the spike D) The player should always position themselves directly in front of the opponent\\n\\nFor each question, provide the answer as a concatenation of the correct choices.\\nSeparate the answers for the questions by comma.\\nFor example, if the correct choices for the main question are A and C, for the first sub-question is D and for the second sub-question are B and D, your final answer must be \\\"AC, D, BD\\\".\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}