{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"28c02002-2656-58ac-ad8d-9ad720a1d17b","task_key":"default--validation--28c02002-2656-58ac-ad8d-9ad720a1d17b","task_revision_id":"1","upstream_id":"","short_description":"does anne of green gables end up with gilbert","config":"default","split":"validation","body":"{\"passage\":\"Anne and Gilbert finally marry at Green Gables, the house Anne grew up in, and move to the village of Four Winds, P.E.I. There, they take up residence in a small house Anne dubs the ``House of Dreams'', and Gilbert takes over his uncle's medical practice in the nearby town of Glen St. Mary. Anne praises her ``house of dreams'' as ``like a creamy seashell stranded on the harbor shore'', which is surrounded by fir trees ``enfolding secrets'' while the lane leading to the house is full of blossoming trees. The house looks up to a harbor on one side and a shining brook in the valley below. Anne's major problem at the House of Dreams is helping her neighbor Leslie Moore, whose husband was left with brain damage after an accident, and who is as emotionally damaged as her husband is brain-damaged.\",\"question\":\"does anne of green gables end up with gilbert\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}