{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ec5a5f2-a5b6-51e6-989e-c3c765dab666","task_key":"default--validation--a25e59e5~2df8b9~2d4eac~2d8caa~2d78c414ffca64","task_revision_id":"1","upstream_id":"a25e59e5-f8b9-4eac-8caa-78c414ffca64","short_description":"How many years after the Germans were massed into Gakovo and Kruševlje was the…","config":"default","split":"validation","body":"{\"passage\":\"According to West German figures in late 1944 the Soviets transported 27,000 to 30,000 ethnic Germans, a majority of whom were women aged 18 to 35, to the Ukraine and the Donbass for forced labour; about 20% (5,683) were reported dead or missing. Data from Russian archives published in 2001, based on an actual enumeration, put the number of German civilians deported from Yugoslavia to the USSR in early 1945 for reparations labour at 12,579, where 16% (1,994) died. After March 1945, a second phase began in which ethnic Germans were massed into villages such as Gakovo and Kruševlje that were converted into labour camps. All furniture was removed, straw placed on the floor, and the expellees housed like animals under military guard, with minimal food and rampant, untreated disease. Families were divided into the unfit women, old, and children, and those fit for slave labour. A total of 166,970 ethnic Germans were interned, and 48,447 (29%) perished. The camp system was shut down in March 1948.\",\"question\":\"How many years after the Germans were massed into Gakovo and Kruševlje was the camp system shut down?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}