{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7683201-49c6-5588-a16f-6f0dac1016f5","task_key":"default--validation--1251dd1f~2d93c7~2d485b~2dbc44~2d0b4943e685b4","task_revision_id":"1","upstream_id":"1251dd1f-93c7-485b-bc44-0b4943e685b4","short_description":"How many years after Ansar al-Islam entered the Iraqi Kurdistan area did…","config":"default","split":"validation","body":"{\"passage\":\"In September 1998, Barzani and Talabani signed the U.S.-mediated Washington Agreement establishing a formal peace treaty. In the agreement, the parties agreed to share revenue, share power, deny the use of northern Iraq to the PKK, and not allow Iraqi troops into the Kurdish regions. The United States pledged to use military force to protect the Kurds from possible aggression by Saddam Hussein. At the same time, implementation of the U.N. Oil-for-Food Programme brought revenue to northern Iraq, allowing for increased standards of living. Iraqi Kurdistan became a relatively peaceful region, before the terrorist group Ansar al-Islam entered the area in December 2001, bringing renewed conflict. Around a month later, U.S. President Bill Clinton signed the Iraq Liberation Act into law, providing for military assistance to Iraqi opposition groups, including the PUK and KDP. The KDP estimated that 58,000 of its supporters had been expelled from PUK-controlled regions from October 1996 to October 1997. The PUK says 49,000 of its supporters were expelled from KDP-controlled regions from August 1996 to December 1997. The PUK and KDP later co-operated with American forces during the 2003 invasion of Iraq, routing Iraqi forces with the help of American air power and overrunning much of northern Iraq including the cities of Kirkuk and Mosul. After the invasion, Massoud Barzani was later elected president of Iraqi Kurdistan while Jalal Talabani was elected President of Iraq.\",\"question\":\"How many years after Ansar al-Islam entered the Iraqi Kurdistan area did American, PUK, and KDP forces co-operate during the invasion of Iraq?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}