{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"22892ac9-eca3-5916-8c92-6012eba43d98","task_key":"default--validation--0d7c7d17~2d4809~2d4d04~2db2a4~2dc163e8159fea","task_revision_id":"1","upstream_id":"0d7c7d17-4809-4d04-b2a4-c163e8159fea","short_description":"Which team scored first?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their bye week, the Chargers went home for a Week 10 AFC West duel with the Kansas City Chiefs.  In the first quarter, San Diego trailed early as Chiefs QB Tyler Thigpen completed a 30-yard TD pass to WR Mark Bradley.  In the second quarter, the 'Bolts got on the board as kicker Nate Kaeding got a 34-yard and a 26-yard field goal.  Kansas City would close out the half as Thigpen completed a 34-yard TD pass to TE Tony Gonzalez (with a failed 2-point conversion). In the third quarter, the Chargers tied the game as QB Philip Rivers completed a 5-yard TD pass to WR Malcom Floyd.  In the fourth quarter, San Diego took the lead as Rivers completed an 8-yard TD pass to TE Antonio Gates.  The Chiefs tried to rally as Thigpen completed a 3-yard TD pass to Gonzalez after a very controversial Pass Interference call on Safety Clinton Hart, in which Gonzalez did not look for a flag, making the call even more controversial.  Fortunately, the Chargers' defense stopped both the 2-point conversion and the ensuing onside kick to preserve their much-needed victory.\",\"question\":\"Which team scored first?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}