{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"affaae9a-13ef-5246-9f49-67cc05271f02","task_key":"default--validation--26aa7b96~2dcef9~2d407f~2d900c~2d6eac6f6b95ba","task_revision_id":"1","upstream_id":"26aa7b96-cef9-407f-900c-6eac6f6b95ba","short_description":"How many more millions of workers were there in 1978 than in 1950?","config":"default","split":"validation","body":"{\"passage\":\"After 1960 public sector unions grew rapidly and secured good wages and high pensions for their members. While manufacturing and farming steadily declined, state- and local-government employment quadrupled from 4 million workers in 1950 to 12 million in 1976 and 16.6 million in 2009. In 2009 the U.S. membership of public sector unions surpassed membership of private sector unions for the first time, at 7.9 million and 7.4 million respectively. In 2011 states faced a growing fiscal crisis and the Republicans had made major gains in the 2010 elections. Public sector unions came under heavy attack especially in Wisconsin, as well as Indiana, New Jersey and Ohio from conservative Republican legislatures. Conservative state legislatures tried to drastically reduce the abilities of unions to collectively bargain.  Conservatives argued that public unions were too powerful since they helped elect their bosses, and that overly generous pension systems were too heavy a drain on state budgets.\",\"question\":\"How many more millions of workers were there in 1978 than in 1950?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}