{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7d6f0a4d-9f45-5107-8f96-7514dac08459","task_key":"default--validation--f6e0777c~2dc76b~2d41ae~2d806c~2d7abaa26a975d","task_revision_id":"1","upstream_id":"f6e0777c-c76b-41ae-806c-7abaa26a975d","short_description":"How many times did Kansas City score in the first half?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their bye week, the Chargers went home for a Week 10 AFC West duel with the Kansas City Chiefs.  In the first quarter, San Diego trailed early as Chiefs QB Tyler Thigpen completed a 30-yard TD pass to WR Mark Bradley.  In the second quarter, the 'Bolts got on the board as kicker Nate Kaeding got a 34-yard and a 26-yard field goal.  Kansas City would close out the half as Thigpen completed a 34-yard TD pass to TE Tony Gonzalez (with a failed 2-point conversion). In the third quarter, the Chargers tied the game as QB Philip Rivers completed a 5-yard TD pass to WR Malcom Floyd.  In the fourth quarter, San Diego took the lead as Rivers completed an 8-yard TD pass to TE Antonio Gates.  The Chiefs tried to rally as Thigpen completed a 3-yard TD pass to Gonzalez after a very controversial Pass Interference call on Safety Clinton Hart, in which Gonzalez did not look for a flag, making the call even more controversial.  Fortunately, the Chargers' defense stopped both the 2-point conversion and the ensuing onside kick to preserve their much-needed victory.\",\"question\":\"How many times did Kansas City score in the first half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}