{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0faef069-c9bf-5500-a81d-1ce8c408b250","task_key":"default--validation--c57fd9ab~2de263~2d4613~2da1d8~2d547ea80ea983","task_revision_id":"1","upstream_id":"c57fd9ab-e263-4613-a1d8-547ea80ea983","short_description":"What two players kicked field goals in the game?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to rebound from their loss to the Texans, the Bengals stayed at home for a Week 7 inter conference duel with the Chicago Bears.  In the first quarter, Cincinnati got off to a fast start as quarterback Carson Palmer completed a 9-yard touchdown pass to wide receiver Chris Henry and an 8-yard touchdown pass to wide receiver Chad Ochocinco.  The Bengals would continue their dominating day in the second quarter as Palmer found tight end J.P. Foschi on a 3-yard touchdown pass and wide receiver Laveranues Coles on an 8-yard touchdown pass, followed by kicker Shayne Graham booting a 29-yard field goal.  The Bears would close out the half with a 22-yard field goal from kicker Robbie Gould. Afterwards, Cincinnati would pull away Palmer finding Ochocinco again on a 13-yard touchdown pass in the third quarter, followed by former Chicago running back Cedric Benson's 1-yard touchdown run.  The Bears would then end the game with quarterback Jay Cutler hooking up with wide receiver Devin Hester on a 5-yard touchdown pass. With the win, the Bengals went into their bye week at 5-2. And also surpassed their win total from last season\",\"question\":\"What two players kicked field goals in the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}