{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ba876356-c1be-5a7b-b943-9f1a2072f0e4","task_key":"default--validation--fdc313ec~2d05f6~2d4303~2dbce1~2dbb8932881f87","task_revision_id":"1","upstream_id":"fdc313ec-05f6-4303-bce1-bb8932881f87","short_description":"How many percentage points higher is the growth rate of Quintana Roo compared to…","config":"default","split":"validation","body":"{\"passage\":\"Since the 1980s, the economy has slowly become less centralized; the annual rate of GDP growth of the Federal District from 2003 to 2004 was the smallest of all federal entities at 0.2%, with drastic drops in the agriculture and industrial sectors. Nonetheless, it still accounts for 21.8% of the nations GDP. The states with the highest GDP growth rates are Quintana Roo (9.0%), Baja California (8.9%), and San Luis Potosí (8.2%). In 2000, the federal entities with the highest GDP per capita in Mexico were the Federal District (US $26,320), Campeche (US $18,900) and Nuevo León (US $30,250); the states with the lowest GDP per capita were Chiapas (US $3,302), Oaxaca (US $4,100) and Guerrero (US $6,800).\",\"question\":\"How many percentage points higher is the growth rate of Quintana Roo compared to the federal district?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}