{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7e5b9b1d-0b5f-5e82-99e5-1932465eba0f","task_key":"default--validation--6561576f~2d64a2~2d47eb~2d9252~2d3baf8d72d825","task_revision_id":"1","upstream_id":"6561576f-64a2-47eb-9252-3baf8d72d825","short_description":"who won the game?","config":"default","split":"validation","body":"{\"passage\":\" Coming off a week 2 loss, the Ravens were determined to bounce back and fight hard. On their second offensive play from scrimmage, Flacco threw a 74-yard touchdown pass to rookie wide receiver Torrey Smith. It was the first catch of Smith's career and the longest pass of Flacco's career. Before the first quarter was up, Flacco would throw two more touchdown passes to Smith for 41 and 18 yards respectively, marking the 12th time in NFL history that any receiver caught three touchdown passes in a single quarter, and the first time ever for a rookie. The Ravens would later add 16 more points on three Billy Cundiff field goals and a fumble forced by Ray Lewis and recovered by Haloti Ngata and then run into the end zone (Cundiff also missed two 51-yard field goals). This marked the first touchdown in Ngata's career. Offensively, the Ravens gained 553 yards in the entire game, a franchise record. The only score for the Rams came in the third quarter, when quarterback Sam Bradford threw a 34-yard touchdown pass to Brandon Gibson.\",\"question\":\"who won the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}