{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fb1deb4c-f47f-5200-9c68-b08c3afde637","task_key":"default--validation--fb1deb4c-f47f-5200-9c68-b08c3afde637","task_revision_id":"1","upstream_id":"","short_description":"does the main character in 12 strong die","config":"default","split":"validation","body":"{\"passage\":\"Following Dostum's departure, Nelson plans to continue operating against the Taliban with his Americans and the few Afghan fighters remaining with them. Encountering a large force of Al-Qaeda and Taliban fighters and armored vehicles, ODA 595, rejoined by Diller and his element, uses air support to eliminate many of the fighters and most of the armor, but are discovered and attacked. Spencer is critically injured by a suicide bomber, and the team is about to be overrun under heavy Taliban and Al-Qaeda pressure when Dostum returns with his forces. Together, the American and Northern Alliance forces disperse the Taliban and Al-Qaeda, and Dostum tracks down and kills Razzan. After Spencer is medevaced, Nelson and Dostum continue to Mazar-i-Sharif but find Atta Muhammad has beaten them there. Against expectations, Dostum and Muhammad meet peacefully and put aside their differences. Impressed by Nelson and the Americans' efforts, Dostum gives Nelson his prized riding crop and tells him that he will always consider Nelson a brother and fellow fighter. Spencer ultimately survives, and ODA 595 returns home after spending 23 days in Afghanistan.\",\"question\":\"does the main character in 12 strong die\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}