{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"76965f94-901f-588b-8362-ab4466fb2178","task_key":"default--validation--7ddc7163~2dfa0a~2d4c7b~2da9a5~2d502866513da1","task_revision_id":"1","upstream_id":"7ddc7163-fa0a-4c7b-a9a5-502866513da1","short_description":"Who received the highest percentage of votes, Obama in 2012, Obama in 2008, or…","config":"default","split":"validation","body":"{\"passage\":\"Modern Clallam County is generally regarded as a competitive area politically. In the United States presidential election, 2016, Donald Trump won with 46.7% of the vote, compared to 44.0% of the vote for Hillary Clinton. In the United States presidential election, 2012, Barack Obama narrowly won with 48.4% of the vote, compared to 48.0% of the vote for Mitt Romney. In the United States presidential election, 2008, Democratic Party (United States) Barack Obama won the county with 50.5% of the vote, compared to 47.2% for Republican candidate John McCain. However, Republican George W. Bush carried Clallam twice, defeating John Kerry by 51.3% to 46.3% in United States presidential election, 2004, and Al Gore by 50.4% to 42.7% in United States presidential election, 2000 (although Bush lost Washington (state) as a whole both times). Clallam County is a bellwether, voting for the nationwide winning candidate in every presidential election from United States presidential election, 1980 onward.\",\"question\":\"Who received the highest percentage of votes, Obama in 2012, Obama in 2008, or Bush in 2004?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}