{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2e1816f-8d57-5be3-a274-e53aa15670de","task_key":"default--validation--c6e29c82~2ddcc6~2d4feb~2db966~2d2fb5e51748b8","task_revision_id":"1","upstream_id":"c6e29c82-dcc6-4feb-b966-2fb5e51748b8","short_description":"In which quarter did the teams both score the same number of points?","config":"default","split":"validation","body":"{\"passage\":\" Following an impressive win over the Panthers, the Texans went home for an AFC South duel with the defending Super Bowl champions, the Indianapolis Colts (who Houston won against last time at home).  In the first quarter, the Texans delivered the first punch with WR Jerome Mathis returning a kickoff 84 yards for a touchdown.  However, the Colts responded with QB Peyton Manning completing a 2-yard TD pass to TE Dallas Clark.  In the second quarter, Houston retook the lead with kicker Kris Brown getting a 33-yard field goal.  However, Indianapolis went ahead with RB Joseph Addais 4-yard TD run. In the third quarter, the Colts managed to put the Texans in a huge hole with kicker Adam Vinatieri's 36-yard field goal, Addai's 8-yard TD run, and Vinatieri's 28-yard field goal.  In the fourth quarter, Houston tried a comeback with RB Samkon Gado's 1-yard TD run.  Indianapolis would get their final score of the game with Vinatieri kicking a 35-yard field goal.  The Texans drew close with QB Matt Schaub's 1-yard TD pass to RB Vonta Leach.  However, the Colts managed to hold on to win.\",\"question\":\"In which quarter did the teams both score the same number of points?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}