{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98f90019-f1ee-52af-943a-975093829130","task_key":"bbeh~5fsportqa--full--98f90019-f1ee-52af-943a-975093829130","task_revision_id":"1","upstream_id":"","short_description":"You will be given a main question and two sub-questions. Each question comes…","config":"bbeh_sportqa","split":"full","body":"{\"input\":\"You will be given a main question and two sub-questions. Each question comes with multiple choices you can select from. For each question, select all the correct choices.\\n\\nMain Question:  How does the type of serve in volleyball, specifically a jump serve and a float serve, impact the offensive strategy in terms of speed, trajectory, and scoring potential, considering different skill levels and match contexts?  A) A jump serve provides higher speed and scoring potential regardless of skill level and match context. B) A float serve provides unpredictable trajectory, making it more effective in all skill levels and match contexts. C) The effectiveness of a jump serve or a float serve largely depends on the skill level of the server and the specific match context. D) Neither a jump serve nor a float serve has a significant impact on the offensive strategy.\\nSub-Question 1:  What factors contribute to the speed and trajectory of a jump serve in indoor volleyball?  A) The height of the jump and the angle of the serve. B) The strength of the server and the type of ball used. C) The position of the server on the court and the direction of the wind. D) The skill level of the server and the resistance of the net.\\nSub-Question 2:  In what match contexts might a float serve be a more effective offensive strategy in volleyball?  A) When the opposing team has a weak defense and the server is highly skilled. B) When the server is less skilled and the opposing team has a strong defense. C) When the match is tied and the server has a high success rate with float serves. D) When the server is highly skilled and the opposing team has a weak offense.\\n\\nFor each question, provide the answer as a concatenation of the correct choices.\\nSeparate the answers for the questions by comma.\\nFor example, if the correct choices for the main question are A and C, for the first sub-question is D and for the second sub-question are B and D, your final answer must be \\\"AC, D, BD\\\".\\n\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}