{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7bc224a1-3687-5890-81c7-3d9877164d34","task_key":"default--validation--3b4fe3ce~2d46e8~2d4fc3~2d8d8c~2d40d1efc82341","task_revision_id":"1","upstream_id":"3b4fe3ce-46e8-4fc3-8d8c-40d1efc82341","short_description":"Who threw an interception for a touchdown?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to increase their winning streak the Titans played on home ground for an Interconference duel with the Eagles. In the second quarter the Titans trailed with kicker David Akers making a 25-yard field goal. But they put themselves ahead with QB Kerry Collins completing a 26-yard TD pass to WR Kenny Britt. The Eagles replied with QB Kevin Kolb making a 5-yard TD pass to WR Riley Cooper, followed by kicker David Akers hitting a 46-yard field goal. In the third quarter the Titans fell further behind with Akers making a 46-yard field goal. They soon replied with kicker Rob Bironas nailing a 41-yard field goal, but the Eagles continued to score in the 4th with Akers getting a 28-yard field goal. Eventually, they rallied to take a big lead with Collins completing an 80-yard TD pass to Britt, followed by Bironas hitting a 38-yard field goal. Then Collins found Britt for the third time in the game on a 16-yard TD pass, and then Bironas made a 33-yard field goal. The Titans continued to get their momentum going with CB Cortland Finnegan returning an interception 41 yards for a touchdown.\",\"question\":\"Who threw an interception for a touchdown?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}