{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4676d170-a137-5d81-a877-7ee5d05d426a","task_key":"default--validation--4676d170-a137-5d81-a877-7ee5d05d426a","task_revision_id":"1","upstream_id":"","short_description":"is somewhere over the rainbow a love song","config":"default","split":"validation","body":"{\"passage\":\"About five minutes into the film, Dorothy sings the song after failing to get Aunt Em, Uncle Henry, and the farmhands to listen to her relate an unpleasant incident involving her dog, Toto, and the town spinster, Miss Gulch (Margaret Hamilton). Aunt Em tells her to ``find yourself a place where you won't get into any trouble''. This prompts her to walk off by herself, musing to Toto, ``Some place where there isn't any trouble. Do you suppose there is such a place, Toto? There must be. It's not a place you can get to by a boat, or a train. It's far, far away. Behind the moon, beyond the rain...'', at which point she begins singing.\",\"question\":\"is somewhere over the rainbow a love song\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}