{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8d5ba52-58a8-5fc7-9e62-ad9171965d63","task_key":"default--validation--b8d5ba52-58a8-5fc7-9e62-ad9171965d63","task_revision_id":"1","upstream_id":"","short_description":"is the summer soltice the longest day of the year","config":"default","split":"validation","body":"{\"passage\":\"The summer solstice (or estival solstice), also known as midsummer, occurs when one of the Earth's poles has its maximum tilt toward the Sun. It happens twice yearly, once in each hemisphere (Northern and Southern). For that hemisphere, the summer solstice is when the Sun reaches its highest position in the sky and is the day with the longest period of daylight. At the pole, there is continuous daylight around the summer solstice. On the summer solstice, Earth's maximum axial tilt toward the Sun is 23.44°. Likewise, the Sun's declination from the celestial equator is 23.44°.\",\"question\":\"is the summer soltice the longest day of the year\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}