{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"db4bc984-a2db-5dab-91d3-a30cf080cea5","task_key":"default--validation--71bd3e7d~2dadda~2d4136~2da6df~2d891ef9b453f3","task_revision_id":"1","upstream_id":"71bd3e7d-adda-4136-a6df-891ef9b453f3","short_description":"Who scored the first touchdown?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to build on their road win over the Falcons, the Browns returned home for Round 1 of their rust belt battle with the Pittsburgh Steelers.  After a scoreless first quarter, the Browns struck first as CB Daven Holly returned an interception 57 yards for a touchdown.  Later, kicker Phil Dawson completed a 23-yard field goal.  In the third quarter, Steelers kicker Jeff Reed completed a 43-yard field goal for the only score of the period.  In the fourth quarter, the true nature of the rivalry would commence.  Dawson would give Cleveland a 35-yard field goal, but Pittsburgh responded with QB Ben Roethlisberger completing a 20-yard TD pass to rookie WR Santonio Holmes.  WR Josh Cribbs would return a kick off 92 yards for a touchdown to give the Browns a 20-10 lead.  However, the Steelers would take the lead with RB Willie Parker getting a 1-yard TD run and a 4-yard touchdown reception.  The Browns final drive of the game almost came up successful, but QB Charlie Frye's 22-yard pass to WR Braylon Edwards fell incomplete.  With the loss, Cleveland fell to last place in the AFC North at 3-7.\",\"question\":\"Who scored the first touchdown?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}