{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c34ddc6e-12c5-533f-8f10-13adc6bda006","task_key":"default--validation--4f823e2e~2dbcf4~2d407e~2dab19~2d66593b49f575","task_revision_id":"1","upstream_id":"4f823e2e-bcf4-407e-ab19-66593b49f575","short_description":"How many points did Mikel Leshoure score single-handedly?","config":"default","split":"validation","body":"{\"passage\":\" In week 9, the Lions flew south to play the Jacksonville Jaguars. After a scoreless first quarter, the Lions' Mikel Leshoure ran in three consecutive touchdowns, from 7, 1, and 8 yards out respectively to take a 21-point lead going into halftime. Leshoure became the first Lions rusher to score three touchdowns in the first half. After a scoreless third quarter, Detroit's Jason Hanson kicked a 42-yard field goal. The Jaguars finally got on the board when Micheal Spurlock caught a 5-yard touchdown pass from Blaine Gabbert; they then completed a two-point conversion when Blaine Gabbert completed a pass to Rashad Jennings. The Lions responded with a 10-yard touchdown run from Joique Bell. Jacksonville scored the final points of the game with a 6-yard touchdown catch from Blaine Gabbert to Justin Blackmon; they again went for a two-point conversion, but were unsuccessful this time. It was the Lions' most lopsided win of the season and would also be their final victory of the 2012 season.\",\"question\":\"How many points did Mikel Leshoure score single-handedly?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}