{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"71322e7a-181c-577b-a115-75916484fb08","task_key":"default--validation--71322e7a-181c-577b-a115-75916484fb08","task_revision_id":"1","upstream_id":"","short_description":"does the mason dixon line go through nj","config":"default","split":"validation","body":"{\"passage\":\"In popular usage, the Mason--Dixon line symbolizes a cultural boundary between the North and the South (Dixie). Originally ``Mason and Dixon's Line'' referred to the border between Pennsylvania and Maryland. After Pennsylvania abolished slavery, it served as a demarcation line for the legality of slavery. That demarcation did not extend beyond Pennsylvania because Delaware, then a slave state, extended north and east of the boundary. Also lying north and east of the boundary was New Jersey, where slavery was formally abolished in 1846, but former slaves continued to be ``apprenticed'' to their masters until the passage of the Thirteenth Amendment to the United States Constitution in 1865.\",\"question\":\"does the mason dixon line go through nj\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}