{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cf1d018a-ec06-5bc9-9da8-94565b7a031f","task_key":"default--validation--13a26b56~2d43c9~2d4f3c~2db177~2df56e13bca63b","task_revision_id":"1","upstream_id":"13a26b56-43c9-4f3c-b177-f56e13bca63b","short_description":"Of the languages listed, which are spoken by fewer than 3,000 people?","config":"default","split":"validation","body":"{\"passage\":\"German has 13,444 speakers representing about 0.4% of the states population, and Vietnamese is spoken by 11,330 people, or about 0.4% of the population, many of whom live in the Asia District, Oklahoma City of Oklahoma City. Other languages include French with 8,258 speakers (0.3%), Chinese Americans with 6,413 (0.2%), Korean with 3,948 (0.1%), Arabic with 3,265 (0.1%), other Asian languages with 3,134 (0.1%), Tagalog language with 2,888 (0.1%), Japanese with 2,546 (0.1%), and African languages with 2,546 (0.1%). In addition to Cherokee, more than 25 Indigenous languages of the Americas are spoken in Oklahoma, second only to California (though, it should be noted only Cherokee exhibits language vitality at present).\",\"question\":\"Of the languages listed, which are spoken by fewer than 3,000 people?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}