{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d5c936f2-d16b-50bc-9bd3-a07b81ff847c","task_key":"default--validation--d5c936f2-d16b-50bc-9bd3-a07b81ff847c","task_revision_id":"1","upstream_id":"","short_description":"was the tiger really on the boat in life of pi","config":"default","split":"validation","body":"{\"passage\":\"The second part of the novel begins with Pi's family aboard the Tsimtsum, a Japanese freighter that is transporting animals from their zoo to North America. A few days out of port from Manila, the ship encounters a storm and sinks. Pi manages to escape in a small lifeboat, only to learn that the boat also holds a spotted hyena, an injured Grant's zebra, and an orangutan named Orange Juice. Much to the boy's distress, the hyena kills the zebra and then Orange Juice. A tiger has been hiding under the boat's tarpaulin: it's Richard Parker, who had boarded the lifeboat with ambivalent assistance from Pi himself some time before the hyena attack. Suddenly emerging from his hideaway, Richard Parker kills and eats the hyena.\",\"question\":\"was the tiger really on the boat in life of pi\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}