{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0fa7d8f3-d904-55c8-a1db-8484e45065cc","task_key":"default--validation--89fe8219~2db100~2d4200~2dbeff~2de803747f2eb4","task_revision_id":"1","upstream_id":"89fe8219-b100-4200-beff-e803747f2eb4","short_description":"Which art gallery came up last, Trescott Street Gallery or Art Euphoric?","config":"default","split":"validation","body":"{\"passage\":\"Taunton has four art galleries: Taunton Art Association , Hughes/Donahue Gallery, Art Euphoric, and the Trescott Street Gallery. The Taunton Art Association founded in 1973, but had it roots at the Girl's Club in the early 1960s. Hughes/Donahue Gallery founded in 2007, a local community gallery serving local Taunton artists, surrounding areas of Southeastern Massachusetts and including the cities of Providence, and Washington DC. Art Euphoric founded in 2008 has both visual and craft exhibits and sales. The Trescott Street Gallery founded in 2012, primarily a visual arts gallery, but also exhibits crafts.\",\"question\":\"Which art gallery came up last, Trescott Street Gallery or Art Euphoric?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}