{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a89afdb3-19ee-558f-94e4-708196b644b4","task_key":"default--validation--f88e7c37~2d0e2e~2d4c0e~2da2b1~2d30d1ac3b71a1","task_revision_id":"1","upstream_id":"f88e7c37-0e2e-4c0e-a2b1-30d1ac3b71a1","short_description":"How many touchdowns did Flacco score in the first half?","config":"default","split":"validation","body":"{\"passage\":\" The Buccaneers traveled to M&T Bank Stadium to face the Baltimore Ravens. In a largely defensive game, the teams traded field goals in the second quarter. The game was tied 3-3 with 4:32 remaining in the first half. Quarterback Joe Flacco struck quickly, however, completing touchdown passes of 65 yards and 10 yards, to Todd Heap and Derrick Mason respectively, just before half time. Trailing 17-3 with about three minutes left in the game, Josh Freeman completed a 5-yard touchdown pass to Kellen Winslow. The Buccaneers were unable to get the ball back on offense, and fell by a score of 17-10.\",\"question\":\"How many touchdowns did Flacco score in the first half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}