{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d730fcf0-aa27-5c34-aa3e-94b88e6fc726","task_key":"default--validation--d730fcf0-aa27-5c34-aa3e-94b88e6fc726","task_revision_id":"1","upstream_id":"","short_description":"does the scapula form a joint with the ribs","config":"default","split":"validation","body":"{\"passage\":\"In anatomy, the scapula (plural scapulae or scapulas; also known as shoulder bone, shoulder blade or wing bone) is the bone that connects the humerus (upper arm bone) with the clavicle (collar bone). Like their connected bones the scapulae are paired, with the scapula on either side of the body being roughly a mirror image of the other. The name derives from early Roman times when it was thought that the bone resembled a trowel or small shovel.\",\"question\":\"does the scapula form a joint with the ribs\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}