{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00099421-1a68-5316-b0da-58c7badfa75e","task_key":"default--validation--320dfca6~2d73ac~2d48c2~2da2a6~2de0fc511a3681","task_revision_id":"1","upstream_id":"320dfca6-73ac-48c2-a2a6-e0fc511a3681","short_description":"Which player scored the first touchdown of the game?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to rebound from their loss to the Texans, the Bengals stayed at home for a Week 7 inter conference duel with the Chicago Bears.  In the first quarter, Cincinnati got off to a fast start as quarterback Carson Palmer completed a 9-yard touchdown pass to wide receiver Chris Henry and an 8-yard touchdown pass to wide receiver Chad Ochocinco.  The Bengals would continue their dominating day in the second quarter as Palmer found tight end J.P. Foschi on a 3-yard touchdown pass and wide receiver Laveranues Coles on an 8-yard touchdown pass, followed by kicker Shayne Graham booting a 29-yard field goal.  The Bears would close out the half with a 22-yard field goal from kicker Robbie Gould. Afterwards, Cincinnati would pull away Palmer finding Ochocinco again on a 13-yard touchdown pass in the third quarter, followed by former Chicago running back Cedric Benson's 1-yard touchdown run.  The Bears would then end the game with quarterback Jay Cutler hooking up with wide receiver Devin Hester on a 5-yard touchdown pass. With the win, the Bengals went into their bye week at 5-2. And also surpassed their win total from last season\",\"question\":\"Which player scored the first touchdown of the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}