{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f11406e4-88b1-5c60-839f-0435be6ecfb4","task_key":"default--validation--a0e4443b~2d0bed~2d4c25~2d9407~2da7b8ff7314c6","task_revision_id":"1","upstream_id":"a0e4443b-0bed-4c25-9407-a7b8ff7314c6","short_description":"How many elections were won by Democrats in the county?","config":"default","split":"validation","body":"{\"passage\":\"Modern Clallam County is generally regarded as a competitive area politically. In the United States presidential election, 2016, Donald Trump won with 46.7% of the vote, compared to 44.0% of the vote for Hillary Clinton. In the United States presidential election, 2012, Barack Obama narrowly won with 48.4% of the vote, compared to 48.0% of the vote for Mitt Romney. In the United States presidential election, 2008, Democratic Party (United States) Barack Obama won the county with 50.5% of the vote, compared to 47.2% for Republican candidate John McCain. However, Republican George W. Bush carried Clallam twice, defeating John Kerry by 51.3% to 46.3% in United States presidential election, 2004, and Al Gore by 50.4% to 42.7% in United States presidential election, 2000 (although Bush lost Washington (state) as a whole both times). Clallam County is a bellwether, voting for the nationwide winning candidate in every presidential election from United States presidential election, 1980 onward.\",\"question\":\"How many elections were won by Democrats in the county?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}