{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"810efd2e-d48e-5f1c-a9ae-f162655ae1c8","task_key":"default--validation--810efd2e-d48e-5f1c-a9ae-f162655ae1c8","task_revision_id":"1","upstream_id":"","short_description":"does the host of americas got talent get a golden buzzer","config":"default","split":"validation","body":"{\"passage\":\"In the ninth season, the show added a new format to the auditions in the form of the ``Golden Buzzer'', which began to make appearances within the Got Talent franchise, since it was first introduced on Germany's Got Talent. During auditions, each judge is allowed to use the Golden Buzzer to send an act automatically into the live shows, regardless of the opinion of the other judges; when it was initially used, the buzzer simply saved an act from elimination. The only rule to the buzzer was that a judge could use it only once per season; the host was later allowed to use the Golden Buzzer for an act from the eleventh season.\",\"question\":\"does the host of americas got talent get a golden buzzer\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}