{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ffa16f8-662a-5223-b49c-6c116a22d63f","task_key":"default--validation--463663ae~2d90b1~2d4ef3~2dad30~2d9e760fcaacac","task_revision_id":"1","upstream_id":"463663ae-90b1-4ef3-ad30-9e760fcaacac","short_description":"Which two players made the score 10-0 in the second quarter?","config":"default","split":"validation","body":"{\"passage\":\" After winning at home, the Bengals traveled down south to take on the Jaguars.  The Jags scored first in the first quarter when Josh Lambo kicked a 32-yard field goal to make it 3-0.  They would make it 10-0 in the second quarter when Blake Bortles found Marqise Lee on a 3-yard pass.  The Bengals got on the board coming within 3 as Joe Mixon ran for a 7-yard touchdown making the score 10-7.  However, the Jags pulled away with Lambo's 56-yard field goal to make it 13-7 at halftime.  In the second half it was all Jags as they scored in the third quarter with Lambo hitting his third field goal of the day from 25 yards out to make it 16-7.  In the fourth quarter, they would wrap up the scoring of the game with Jaydon Mickens 63-yard punt return for a touchdown and the final score 23-7. The game was notable seeing  A.J. Green getting ejected in the second quarter after fighting with Jacksonville's Jalen Ramsey, who was also ejected.\",\"question\":\"Which two players made the score 10-0 in the second quarter?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}