{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3dd99e41-085a-5c63-bf99-a74e80c5617d","task_key":"default--validation--f96009f4~2da507~2d489e~2d9cac~2d4d47c2e1b2d3","task_revision_id":"1","upstream_id":"f96009f4-a507-489e-9cac-4d47c2e1b2d3","short_description":"How many years before he was appointed archbishop in 2001 was Leo Makkonen the…","config":"default","split":"validation","body":"{\"passage\":\"The seat of the Archbishop of Karelia and All Finland is in Kuopio. The archbishop is the head of the church and the diocese. He is assisted in the diocese by a suffragan bishop known as the Bishop of Joensuu. Despite his title, the bishop is also seated at Kuopio. The word \\\"Karelia\\\" in the archbishop's title only refers to the Finnish Karelia. The current Archbishop, Leo Makkonen, was born in 1948. Before his appointment as the archbishop in 2001, he was the Metropolitan of Helsinki from 1996, and Metropolitan of Oulu from 1980. The current Bishop of Joensuu is Arseni, who took the position in 2005. The Diocese of Karelia has 22,000 church members in 12 parishes. The number of priests in the diocese is about 45, and churches and chapels total over 80. The diocese also includes the only orthodox monasteries in Finland. The Orthodox Church Museum of Finland also operates in Kuopio.\",\"question\":\"How many years before he was appointed archbishop in 2001 was Leo Makkonen the Metropolitan of Oulu?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}