{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d1252793-744d-5d3f-a0ba-ec43d9f8684a","task_key":"default--validation--3437752f~2dae59~2d4f3b~2d802e~2d48eabe63224a","task_revision_id":"1","upstream_id":"3437752f-ae59-4f3b-802e-48eabe63224a","short_description":"How many scoring plays were there in the first half?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to build on their road win over the Falcons, the Browns returned home for Round 1 of their rust belt battle with the Pittsburgh Steelers.  After a scoreless first quarter, the Browns struck first as CB Daven Holly returned an interception 57 yards for a touchdown.  Later, kicker Phil Dawson completed a 23-yard field goal.  In the third quarter, Steelers kicker Jeff Reed completed a 43-yard field goal for the only score of the period.  In the fourth quarter, the true nature of the rivalry would commence.  Dawson would give Cleveland a 35-yard field goal, but Pittsburgh responded with QB Ben Roethlisberger completing a 20-yard TD pass to rookie WR Santonio Holmes.  WR Josh Cribbs would return a kick off 92 yards for a touchdown to give the Browns a 20-10 lead.  However, the Steelers would take the lead with RB Willie Parker getting a 1-yard TD run and a 4-yard touchdown reception.  The Browns final drive of the game almost came up successful, but QB Charlie Frye's 22-yard pass to WR Braylon Edwards fell incomplete.  With the loss, Cleveland fell to last place in the AFC North at 3-7.\",\"question\":\"How many scoring plays were there in the first half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}