{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2cc8cce9-16a3-5262-b2ed-5fd96a05579a","task_key":"default--validation--2cc8cce9-16a3-5262-b2ed-5fd96a05579a","task_revision_id":"1","upstream_id":"","short_description":"does every name in iceland end in son","config":"default","split":"validation","body":"{\"passage\":\"Some family names do exist in Iceland, most commonly adaptations from last name patronyms Icelanders took up when living abroad, usually Denmark. Notable Icelanders who have an inherited family name include former prime minister Geir Haarde, football star Eiður Smári Guðjohnsen, entrepreneur Magnús Scheving, film director Baltasar Kormákur Samper, actress Anita Briem and member of parliament (and former news reporter) Elín Hirst. Before 1925, it was legal to adopt new family names; one Icelander to do so was the Nobel Prize-winning author Halldór Laxness, while another author, Einar Hjörleifsson and his brothers all chose the family name ``Kvaran''. Since 1925, one cannot adopt a family name unless one explicitly has a legal right to do so through inheritance. (The law was amended in 1991 and 1996.)\",\"question\":\"does every name in iceland end in son\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}