{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c017308-648b-5cc7-924a-031a1570bab8","task_key":"default--validation--4c017308-648b-5cc7-924a-031a1570bab8","task_revision_id":"1","upstream_id":"","short_description":"has saudi arabia signed the universal declaration of human rights","config":"default","split":"validation","body":"{\"passage\":\"The meeting record provides firsthand insight into the debate. South Africa's position can be seen as an attempt to protect its system of apartheid, which clearly violated several articles in the Declaration. The Saudi Arabian delegation's abstention was prompted primarily by two of the Declaration's articles: Article 18, which states that everyone has the right ``to change his religion or belief''; and Article 16, on equal marriage rights. The six communist countries abstentions centred around the view that the Declaration did not go far enough in condemning fascism and Nazism. Eleanor Roosevelt attributed the abstention of Soviet bloc countries to Article 13, which provided the right of citizens to leave their countries.\",\"question\":\"has saudi arabia signed the universal declaration of human rights\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}