{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e10ed88d-03dc-50a0-afa9-1cd47e1cd67e","task_key":"default--validation--7b60564d~2d6a91~2d41c9~2d9f76~2dffa06b0137ff","task_revision_id":"1","upstream_id":"7b60564d-6a91-41c9-9f76-ffa06b0137ff","short_description":"How many years after the Danish navy officially ordered nine MH-60R Seahawk…","config":"default","split":"validation","body":"{\"passage\":\"Helicopters are deployed from the air force's 723rd squadron to Danish naval ships. When initiated in 1962, the naval helicopters consisted of a flight of Alouette helicopters of RDAF squadron 722. Primarily for use on the Thetis class in operations in Greenland and Faroe Islands, but also on Absalon class in international operations and Knud Rasmussen class off Greenland as well as participating in exercises. The independent unit was established in 1977 as \\\"Søværnets Flyvetjeneste\\\" operating  and Westland Lynx  helicopters.  On December 6, 2012, the Danish navy officially ordered nine MH-60R Seahawk helicopters, with all to be delivered by 2018, following a competition on the procurement involving the NH90, AgustaWestlands AW159 Wildcat and the AW101 along with Sikorsky's other bid H-92 Superhawk.\",\"question\":\"How many years after the Danish navy officially ordered nine MH-60R Seahawk helicopters was it expected that they would be delivered?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}