{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0c86954-7cde-5bec-b206-5f00224e7554","task_key":"default--validation--91f74d9e~2df979~2d4858~2d9d30~2d3def88b1fa30","task_revision_id":"1","upstream_id":"91f74d9e-f979-4858-9d30-3def88b1fa30","short_description":"How many touchdowns did Bears make in the first half of the game?","config":"default","split":"validation","body":"{\"passage\":\" Wearing bright orange uniforms and showing their speed on defense and special teams, the Chicago Bears overwhelmed the 49ers who were coming off their Bye Week. They jumped to a 24-0 first-quarter lead and 41-0 halftime cushion before coasting to a 41-10 victory. Brian Urlacher's one-handed interception was headed to the highlight reel as soon as he tumbled to the ground after somehow batting the ball to himself. Urlacher's stellar play symbolized what kind of afternoon it was for the refreshed and still unbeaten Chicago Bears - and how frustrating the day was for the San Francisco 49ers. San Francisco entered giving up 32 points a game, but the defense wasn't to fault early on because turnovers allowed the Bears to work from short fields. Drives started at the 15, 41 and 13, and they turned all three into touchdowns to take the big opening-quarter lead. The 49ers coughed up the ball a fourth time late in the half when WR Antonio Bryant caught a pass and fumbled, with CB Ricky Manning Jr. recovering. San Francisco averted a shutout in the fourth quarter on a 23-yard field goal by K Joe Nedney and a 16-yard TD pass from Smith to WR Antonio Bryant. QB Alex Smith finished 16 of 26 for 146 yards. RB Frank Gore rushed for 111 yards on 12 carries, thanks to a 53-yard run. The 49ers now stand at 2-5.\",\"question\":\"How many touchdowns did Bears make in the first half of the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}