{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4fcf3d7e-e366-5cd0-a6dc-c2e9369ac8e2","task_key":"default--validation--4fcf3d7e-e366-5cd0-a6dc-c2e9369ac8e2","task_revision_id":"1","upstream_id":"","short_description":"does sam come back to the west wing","config":"default","split":"validation","body":"{\"passage\":\"Although Sam is mentioned occasionally following his departure -- most notably calling Josh to tell him to ``roll with the punches'' after the latter unwittingly caused the defection of a Democratic Senator -- he is not seen in the series until the last episodes of the seventh and final season, following the election of Congressman Matt Santos as President. Resolving the debate over the result of the California 47th's special election, it is implied that Sam was defeated by Congressman Webb and declined the promotion to Senior Counselor to the President that had been suggested by Toby. After summarily quitting politics, Sam remained in his home state of California and joined an unnamed law firm in Los Angeles which pays him a salary that would ``make (Josh) puke''.\",\"question\":\"does sam come back to the west wing\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}