{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"599222e8-b8db-56c7-b815-6f05378fad6b","task_key":"default--validation--599222e8-b8db-56c7-b815-6f05378fad6b","task_revision_id":"1","upstream_id":"","short_description":"is the movie the shape of water based on a book","config":"default","split":"validation","body":"{\"passage\":\"The idea for The Shape of Water formed during del Toro's breakfast with Daniel Kraus in 2011, with whom he later co-wrote the novel Trollhunters. It shows similarities to the 2015 short film The Space Between Us. It was also primarily inspired by del Toro's childhood memories of seeing Creature from the Black Lagoon and wanting to see the Gill-man and Kay Lawrence (played by Julie Adams) succeed in their romance. When del Toro was in talks with Universal to direct a remake of Creature from the Black Lagoon, he tried pitching a version focused more on the creature's perspective, where the Creature ended up together with the female lead, but the studio executives rejected the concept.\",\"question\":\"is the movie the shape of water based on a book\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}