{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e8454635-6fe9-5390-9e1c-9a057d37e851","task_key":"default--validation--e8454635-6fe9-5390-9e1c-9a057d37e851","task_revision_id":"1","upstream_id":"","short_description":"can you make prawn crackers in the microwave","config":"default","split":"validation","body":"{\"passage\":\"Most varieties of prawn crackers can also be prepared in a microwave oven, in which a few discs can be cooked in less than a minute. This will usually cause them to cook and expand in a way similar to when they are deep fried. For small quantities, this method is faster and less messy, as the crackers do not become as oily. However, this may cause the cracker to retain a stronger aroma of raw shrimp and the cracker has to be consumed within hours before it softens and loses its crispness.\",\"question\":\"can you make prawn crackers in the microwave\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}