{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ba370232-36b0-5bff-9762-c7dcbedc4625","task_key":"default--validation--cefafe3c~2dbd6e~2d4f8e~2dbd58~2de817cc77ca68","task_revision_id":"1","upstream_id":"cefafe3c-bd6e-4f8e-bd58-e817cc77ca68","short_description":"Who broke the truce first, KDP or PUK?","config":"default","split":"validation","body":"{\"passage\":\"Fighting continued throughout the winter between the KDP and PUK. Complicating matters, PKK was present in Iraq. PKK was allied with the PUK which later led KDP attack the PKK. According to some sources, the PKK began to fight against all who supported KDP, including some Assyrian and Arab groups. Turkey which saw the Kurdish Civil war as an opportunity, allied with KDP and launched Operation Hammer in May, in a violent attempt to force the PKK to leave Iraqi Kurdistan. This operation caused heavy PKK casualties but was unsuccessful. PKK succeeded to keep their camps in Northern Iraq. On 25 September 1997, Turkish forces re-entered Iraqi Kurdistan and attacked PUK and PKK positions in an attempt to force the PKK to leave Iraqi Kurdistan. However, according to Turkish sources, it was an attempt to bring a cease-fire between the factions. The operation resulted in heavy PKK and PUK casualties. Later a cease-fire was negotiated between the PUK and KDP after the US decision to support a cease-fire. Despite the cease-fire, renewed fighting broke out along the armistice line between the KDP and PUK in October and November. In this round of fighting, 1,200 combatants were killed on both sides and 10,000 civilians fled their homes. On 24 November 1997, the KDP declared a unilateral cease-fire. The PUK, although not declaring a cease-fire officially, said their group would respect the truce, despite alleging that the KDP had violated the truce by attacking PUK positions on 25 November.\",\"question\":\"Who broke the truce first, KDP or PUK?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}