{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85b01d45-2315-55f4-8e5e-e84f590c15ea","task_key":"default--validation--deb00dee~2d58f8~2d4485~2db670~2d7513a3b01dc7","task_revision_id":"1","upstream_id":"deb00dee-58f8-4485-b670-7513a3b01dc7","short_description":"The Texans can clinch homefield advantage throughout the playoffs by winning at…","config":"default","split":"validation","body":"{\"passage\":\" (2012 Indianapolis Colts season)With their victory over the Colts, the Texans improved to 12-2 on the season and 5-0 against division rivals, thereby securing their second AFC South title in franchise history. Because the Patriots dropped to 10-4 several hours later on the same day, the Texans can clinch homefield advantage throughout the playoffs by winning at least one of their two remaining games by virtue of their head-to-head tiebreaker over the Broncos.\",\"question\":\"The Texans can clinch homefield advantage throughout the playoffs by winning at least how many more games?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}