{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a088920c-9cb2-520b-b898-332260a53fb4","task_key":"default--validation--4a964c39~2d47ad~2d4bba~2d8942~2dc98cb289afb3","task_revision_id":"1","upstream_id":"4a964c39-47ad-4bba-8942-c98cb289afb3","short_description":"Which team scored last in the second quarter, the Ravens or Lions?","config":"default","split":"validation","body":"{\"passage\":\" In week 14, the Lions traveled to rainy Baltimore, Maryland for an interconference duel with the Baltimore Ravens. Baltimore lead for almost the entire game. They scored first late in the first quarter with a 38-yard field goal by Billy Cundiff. They added to their lead with a 62-yard catch and run TD by Derrick Mason from Joe Flacco. The Lions scored their only points of the game near the end of the second quarter with a 22-yard Jason Hanson field goal. A minute later the Ravens responded with a 59-yard rushing TD by Ray Rice. Baltimore finished out the first half with a 25-yard field goal. In the second half the Ravens scored 4 consecutive touchdowns. First a Le'Ron McClain 3-yard run. Then 2 by Willis McGahee: first an 8-yard run, then a 19-yard run. In the fourth quarter, the Ravens capped off their huge victory when Troy Smith ran in a TD from 15 yards. Lions backup quarterback Daunte Culpepper completed less than half of his passes (16 for 34) and threw 2 interceptions.\",\"question\":\"Which team scored last in the second quarter, the Ravens or Lions?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}