{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9913f046-62d0-5497-9bc5-61789b71c9f0","task_key":"default--validation--9680fb92~2d96bc~2d4a7f~2d9600~2d9f4998e4869f","task_revision_id":"1","upstream_id":"9680fb92-96bc-4a7f-9600-9f4998e4869f","short_description":"How many more percentage points of effectiveness was the Salk vaccine against…","config":"default","split":"validation","body":"{\"passage\":\"Salks vaccine was then used in a test called the Francis Field Trial, led by Thomas Francis, Jr., the largest medical experiment in history at that time. The test began with about 4,000 children at Franklin Sherman Elementary School in McLean, Virginia, and eventually involved 1.8 million children, in 44 states from Maine to California. By the conclusion of the study, roughly 440,000 received one or more injections of the vaccine, about 210,000 children received a placebo, consisting of harmless culture media, and 1.2 million children received no vaccination and served as a control group, who would then be observed to see if any contracted polio. The results of the field trial were announced 12 April 1955 (the tenth anniversary of the death of President Franklin D. Roosevelt, whose Franklin D. Roosevelts paralytic illness was generally believed to have been caused by polio). The Salk vaccine had been 60-70% effective against PV1 (poliovirus type 1), over 90% effective against PV2 and PV3, and 94% effective against the development of bulbar polio. Soon after Salks vaccine was licensed in 1955, childrens vaccination campaigns were launched. In the U.S, following a mass immunization campaign promoted by the March of Dimes, the annual number of polio cases fell from 35,000 in 1953 to 5,600 by 1957. By 1961 only 161 cases were recorded in the United States.\",\"question\":\"How many more percentage points of effectiveness was the Salk vaccine against PV2 and PV3 than against PV1 at best?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}