{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"76bb01b8-c63b-5e71-b523-06c7764b9069","task_key":"default--validation--bac6a23e~2d4aef~2d44d7~2d8a09~2dae5cdd9f6de9","task_revision_id":"1","upstream_id":"bac6a23e-4aef-44d7-8a09-ae5cdd9f6de9","short_description":"How many points were scored in the first half of the game?","config":"default","split":"validation","body":"{\"passage\":\" Arizona dominated St Louis to win the NFC West and clinch their first home playoff game since 1947. Arizona took a 14-0 lead in the first quarter after a one-yard TD run by Tim Hightower and a Kurt Warner 12-yard TD pass to Larry Fitzgerald. In the second quarter the Rams would score on a three-yard TD pass from Marc Bulger to Steven Jackson, following a Kurt Warner interception. The Cardinals would respond with two field goals from Neil Rackers from 44 and 22 yards to make the halftime score 20-7. In the third quarter, Cardinals linebacker, Gerald Hayes, would force two Steven Jackson fumbles, the second one recovered by Darnell Dockett, who would return it 11 yards to the end zone for a touchdown. Down 27-7, the Rams attempted to come back in the fourth quarter, starting with a Josh Brown 51-yard field goal to make the score 27-10, but a Bulger pass was intercepted by rookie cornerback, Dominique Rodgers-Cromartie, for 99 yards, for the touchdown that sealed the game and propelled the Cardinals to their first playoff game since 1998, and their first division title since the days the Cardinals were in St. Louis in 1975.\",\"question\":\"How many points were scored in the first half of the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}