{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0b338e8d-eb0c-5478-83c2-c437e3a66459","task_key":"default--validation--0b338e8d-eb0c-5478-83c2-c437e3a66459","task_revision_id":"1","upstream_id":"","short_description":"did marv die in the first sin city","config":"default","split":"validation","body":"{\"passage\":\"Marv survives, however, creating a problem for the Roark family and the corrupt police force as he possesses knowledge that would have the city implode. The police threaten to kill Marv's mother unless he confesses to the murders that Roark and Kevin committed; Marv agrees, but only after breaking an attorney's arm in three places. He is sentenced to die in the electric chair. Before his execution, Wendy visits him one last time to thank him for everything he has done. Marv goes to the chair, but survives the first jolt, defiantly saying to his executioners: ``Is that the best you can do, you pansies?'' They have to pull the switch again to finish him off, announcing ``He's gone''.\",\"question\":\"did marv die in the first sin city\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}