{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"28d9b498-37c1-5a06-a2bd-fc335f6a762d","task_key":"default--validation--cd7c2f83~2d85c3~2d43a2~2d8220~2df2a5005ee62e","task_revision_id":"1","upstream_id":"cd7c2f83-85c3-43a2-8220-f2a5005ee62e","short_description":"How many of the applicants did Fordham not accept in 2019?","config":"default","split":"validation","body":"{\"passage\":\"In 2016, the university accepted approximately 43% of all applicants across both its undergraduate and graduate programs. For the undergraduate class of 2019, Fordham accepted 20,366 of the 42,811 applicants (47.6%) and enrolled 2,211. The middle 50% range of SAT scores for enrolled freshmen was 580-670 for critical reading, 590-680 for math, and 590-680 for writing, while the ACT (examination) Composite middle 50% range was 28-33. The average high school GPA of incoming freshmen was 3.64.\",\"question\":\"How many of the applicants did Fordham not accept in 2019?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}