{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89fdc1b8-548d-586a-8c63-d2091dc7f3ea","task_key":"default--validation--89fdc1b8-548d-586a-8c63-d2091dc7f3ea","task_revision_id":"1","upstream_id":"","short_description":"are clary and jace really brother and sister","config":"default","split":"validation","body":"{\"passage\":\"Clary learns that Valentine Morgenstern, the main antagonist of the series, is her biological father and her mother's ex-husband. At the end of City of Bones, Valentine tells them that Clary and Jace are siblings -- which, they discover later in the series, is a lie. In the second book of the series, City of Ashes, Clary dates her best friend Simon, who has for a long time had a crush on her, in order to forget Jace during the torturous time of believing him to be her brother. She is told by the Seelie Queen that she has the ability to create runes that don't exist; but they do exist, which later enables her to destroy Valentine's ship using the ``Open'' rune. In the end of the second novel, Clary finds that an old friend of her mother, Madeleine, knows how to wake her mother, who has been in a magical coma since the first book.\",\"question\":\"are clary and jace really brother and sister\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}