{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0166bad2-af3f-56b0-9fec-6f0810d3fbc4","task_key":"default--validation--58d1fc14~2da962~2d45aa~2da490~2dbec00bd52089","task_revision_id":"1","upstream_id":"58d1fc14-a962-45aa-a490-bec00bd52089","short_description":"What Democratic candidates lost in the county?","config":"default","split":"validation","body":"{\"passage\":\"Modern Clallam County is generally regarded as a competitive area politically. In the United States presidential election, 2016, Donald Trump won with 46.7% of the vote, compared to 44.0% of the vote for Hillary Clinton. In the United States presidential election, 2012, Barack Obama narrowly won with 48.4% of the vote, compared to 48.0% of the vote for Mitt Romney. In the United States presidential election, 2008, Democratic Party (United States) Barack Obama won the county with 50.5% of the vote, compared to 47.2% for Republican candidate John McCain. However, Republican George W. Bush carried Clallam twice, defeating John Kerry by 51.3% to 46.3% in United States presidential election, 2004, and Al Gore by 50.4% to 42.7% in United States presidential election, 2000 (although Bush lost Washington (state) as a whole both times). Clallam County is a bellwether, voting for the nationwide winning candidate in every presidential election from United States presidential election, 1980 onward.\",\"question\":\"What Democratic candidates lost in the county?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}