{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a013893b-e606-54ab-9947-646bcfe7f44e","task_key":"default--validation--a013893b-e606-54ab-9947-646bcfe7f44e","task_revision_id":"1","upstream_id":"","short_description":"is the tour de france different every year","config":"default","split":"validation","body":"{\"passage\":\"Traditionally, the race is held primarily in the month of July. While the route changes each year, the format of the race stays the same with the appearance of time trials, the passage through the mountain chains of the Pyrenees and the Alps, and the finish on the Champs-Élysées in Paris. The modern editions of the Tour de France consist of 21 day-long segments (stages) over a 23-day period and cover around 3,500 kilometres (2,200 mi). The race alternates between clockwise and counterclockwise circuits of France.\",\"question\":\"is the tour de france different every year\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}