{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d6f655ce-11d4-5a7c-8e4a-236f32affa26","task_key":"default--validation--cf14dfe5~2db75a~2d44dc~2db954~2d434816173489","task_revision_id":"1","upstream_id":"cf14dfe5-b75a-44dc-b954-434816173489","short_description":"How many years was it before the Dutch Reformed Church of Ceylon changed its…","config":"default","split":"validation","body":"{\"passage\":\"Through the Dutch East India Company and its workers, the Dutch Reformed Church was established in Ceylon in 1642. The Dutch Reformed Church of Ceylon officially changed its name in 2007 to the Christian Reformed Church of Sri Lanka to reflect its Christian identity in the nation, rather than on its Dutch colonial heritage.  As of 2007, its membership stands around 5,000, comprising both communicant and baptised members in 29 congregations, preaching stations, and mission outposts. Christianity in Indonesia is strongly influenced under the Dutch reformed church, the first known church established in the country is \\\"De Oude kerk\\\" in Batavia in 1640. Christianity in Indonesia, like Sri Lanka, has been nationalised into different branches of Protestantism while retaining many of the reformed church elements.\",\"question\":\"How many years was it before the Dutch Reformed Church of Ceylon changed its name?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}