{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b93b9996-04b1-56fc-bc52-5bc95c5fd8fd","task_key":"default--validation--b93b9996-04b1-56fc-bc52-5bc95c5fd8fd","task_revision_id":"1","upstream_id":"","short_description":"does the robot in lost in space talk","config":"default","split":"validation","body":"{\"passage\":\"Although a machine endowed with superhuman strength and futuristic weaponry, he often displayed human characteristics, such as laughter, sadness, and mockery, as well as singing and playing the guitar. With his major role often being to protect the youngest member of the crew, the Robot's catchphrases were ``It does not compute'' and ``Danger, Will Robinson!'', accompanied by flailing his arms.\",\"question\":\"does the robot in lost in space talk\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}