{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4894ef3d-ba28-5ce1-83a4-a0f4a6464073","task_key":"default--validation--4894ef3d-ba28-5ce1-83a4-a0f4a6464073","task_revision_id":"1","upstream_id":"","short_description":"is aldi the largest grocer in the world","config":"default","split":"validation","body":"{\"passage\":\"In the United Kingdom, Aldi has won Supermarket of the Year two years in a row (2012/13), and in 2013, Aldi won the Grocer of the Year Award. However, in February 2015, Aldi narrowly lost to Waitrose for the title of Supermarket of the Year 2015. In April 2015, Aldi overtook Waitrose to become the United Kingdom's sixth-largest supermarket chain. In February 2017, Aldi overtook Co-op to become the United Kingdom's fifth largest supermarket chain.. In May 2017, Aldi lost out to Marks & Spencer for the title of 'Which? Supermarket of the Year 2017. In the United States, due to the relatively low staffing of Aldi locations compared to other supermarket chains, Aldi has a reputation of starting employees out at significantly higher than minimum wage, unusual among American supermarkets.\",\"question\":\"is aldi the largest grocer in the world\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}