{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"dea36f32-02a1-5437-bb47-018d565c45f5","task_key":"default--validation--dea36f32-02a1-5437-bb47-018d565c45f5","task_revision_id":"2","upstream_id":"","short_description":"do alligators drown their prey and eat it later","config":"default","split":"validation","body":"{\"passage\":\"Although the alligator has a heavy body and a slow metabolism, it is capable of short bursts of speed, especially in very short lunges. Alligators' main prey are smaller animals they can kill and eat with a single bite. They may kill larger prey by grabbing it and dragging it into the water to drown. Alligators consume food that cannot be eaten in one bite by allowing it to rot, or by biting and then spinning or convulsing wildly until bite-sized chunks are torn off. This is referred to as a ``death roll''. Critical to the alligator's ability to initiate a death roll, the tail must flex to a significant angle relative to its body. An alligator with an immobilized tail cannot perform a death roll.\",\"question\":\"do alligators drown their prey and eat it later\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}