{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"291733a5-a9fd-59d2-b904-241bf6f1e8b7","task_key":"default--validation--291733a5-a9fd-59d2-b904-241bf6f1e8b7","task_revision_id":"1","upstream_id":"","short_description":"can you run on a caught foul ball","config":"default","split":"validation","body":"{\"passage\":\"In baseball, to tag up is for a baserunner to retouch or remain on their starting base (the time-of-pitch base) until (after) the ball either lands in fair territory or is first touched by a fielder. By rule, baserunners must tag up when a fly ball is caught in flight by a fielder. After a legal tag up, runners are free to attempt to advance, even if the ball was caught in foul territory. On long fly ball outs, runners can often gain a base; when a runner scores by these means, this is called a sacrifice fly. On short fly balls, runners seldom attempt to advance after tagging up, due to the high risk of being thrown out.\",\"question\":\"can you run on a caught foul ball\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}