{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d265ad19-963f-5351-b2cc-ad26021461ab","task_key":"default--validation--d265ad19-963f-5351-b2cc-ad26021461ab","task_revision_id":"1","upstream_id":"","short_description":"does mr darcy die in pride and prejudice and zombies","config":"default","split":"validation","body":"{\"passage\":\"While fighting, Darcy stabs Wickham's chest, revealing him to have been undead all along, staying civilized by consuming pig brains. Elizabeth saves Darcy from being killed by Wickham. As the two ride across the bridge, the army destroys it to keep the zombies from crossing over from London. Darcy is injured in the explosion and Elizabeth tearfully admits her love for him. After Darcy recovers, he proposes to Elizabeth again and this time, she agrees. The two have a joint wedding with Bingley and Jane. In a mid-credits scene, Wickham leads a horde of zombies toward the wedding celebration with the Four Horsemen of the Zombie Apocalypse riding behind him.\",\"question\":\"does mr darcy die in pride and prejudice and zombies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}