{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"322f2076-6b9b-533b-b887-3a1e8e2a2831","task_key":"default--validation--fac208a2~2d5081~2d49a4~2d8e15~2d6cf8cde1ee78","task_revision_id":"1","upstream_id":"fac208a2-5081-49a4-8e15-6cf8cde1ee78","short_description":"Which cost more, the Sikorsky CH-53E Super Stallion cost per flight hour in 2007…","config":"default","split":"validation","body":"{\"passage\":\"By 2012, the USMC reported fleetwide readiness rate had risen to 68 percent; however, the DODs Inspector General later found 167 of 200 reports had \\\"improperly recorded\\\" information. Captain Richard Ulsh blamed these errors on incompetence and said that they were \\\"not malicious\\\" or deliberate. The required mission capable rate was 82%, but the average was 53% from June 2007 to May 2010. In 2010, Naval Air Systems Command aimed for an 85% reliability rate by 2018. From 2009 to 2014, readiness rates rose 25 percent to the \\\"high 80s\\\", while operating cost had dropped 20 percent to $9,520 through a rigorous maintenance improvement program that focused on diagnosing problems before failures occur. , although the V-22 requires higher maintenance and has lower availability (62%) than traditional helicopters, it also has a lower incidence rate. The average cost per flight hour is , whereas the Sikorsky CH-53E Super Stallion cost about $20,000 per flight hour in 2007. V-22 Total cost of ownership was $83,000 per hour in 2013.\",\"question\":\"Which cost more, the Sikorsky CH-53E Super Stallion cost per flight hour in 2007 or V-22 total cost of ownership per hour in 2013?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}