{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"944a2b15-eba6-55f2-99b8-49107672b050","task_key":"default--validation--1f475bf9~2de19b~2d4fb2~2db565~2d4295322354f5","task_revision_id":"1","upstream_id":"1f475bf9-e19b-4fb2-b565-4295322354f5","short_description":"How many wells were the Walkertons alternating between?","config":"default","split":"validation","body":"{\"passage\":\"In the spring of 2000, Walkertons system typically drew most of its water from one well at a time, alternating unevenly between wells 5, 6, and 7. Well 7 was turned off between March 10 and May 2, ran alone from May 2 through May 9 before turning off again, and was then used again between May 15 and May 19. From May 9 to May 13, Well 5 provided the bulk of Walkertons water, supplemented from May 10–13 by Well 6. Though Well 7 ran without chlorination between May 3 and May 9, expert evaluation of well 7s pumping schedule and lack of physical vulnerabilities to contamination concluded that it was highly unlikely to have been involved in the outbreak. Well 6, which records indicate was out of service beginning May 13, was similarly determined to have been unlikely to have been the source of contamination based on its location and characteristics.\",\"question\":\"How many wells were the Walkertons alternating between?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}