{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b9887c51-4ef8-5c95-b9ce-0082f39c4d35","task_key":"default--validation--f3261fe6~2d06b9~2d4ec4~2daa2d~2dda7cf72d9243","task_revision_id":"1","upstream_id":"f3261fe6-06b9-4ec4-aa2d-da7cf72d9243","short_description":"Which three organizations ranked the University of Sussex on its contribution to…","config":"default","split":"validation","body":"{\"passage\":\"The University of Sussex is a research-intensive university and was ranked 62nd in Europe and 147th in the world by The Times Higher Education World University Rankings 2018. The university was ranked 228th in the world according to the QS World University Rankings 2018 (the first time it ever ranks outside of the QS top 200); it placed 187th in 2017. The university placed in the top 1 percent in the world in the 2017 CWUR ranking, coming at number 117 in the world for quality of education. Sussex ranked as 66th in the world in 2016 for its sustainability on the UI GreenMetric ranking.  It was ranked 39th in the world in the 2018 installment of The Times Higher Education World University Rankings for the social sciences, 11th in Europe and seventh in the United Kingdom. It ranked as 49th in the world for Law and 48th for Business and Economics. The university also ranked in the top 100 in the world for the social sciences in the CWTS Leiden Ranking 2016 and in the top 150 in the world for Social Sciences ARWU 2016 and 90th best in the world for Psychological Sciences in the U.S. News & World Report.\",\"question\":\"Which three organizations ranked the University of Sussex on its contribution to Social Sciences?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}