{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19fb8d50-5f03-5e58-8c03-4959647bb574","task_key":"default--validation--fe7c7e41~2d7a13~2d4dba~2d83f3~2d177f0ceabc82","task_revision_id":"1","upstream_id":"fe7c7e41-7a13-4dba-83f3-177f0ceabc82","short_description":"How many Doctors of Medicines are not specialists?","config":"default","split":"validation","body":"{\"passage\":\"There are hundreds of healthcare institutions in Croatia, including 79 hospitals and clinics with 23,967 beds. The hospitals and clinics care for more than 700 thousand patients per year and employ 5,205 Doctor of Medicine, including 3,929 specialists. There are 6,379 private practice offices, and a total of 41,271 health workers in the country. There are 63 emergency medical service units, responding to more than a million calls. The principal cause of death in 2008 was cardiovascular disease at 43.5% for men and 57.2% for women, followed by tumours, at 29.4% for men and 21.4% for women. In 2009 only 13 Croatians had been infected with HIV/AIDS and 6 had died from the disease. In 2008 it was estimated by the WHO that 27.4% of Croatians over the age of 15 are smokers. According to 2003 WHO data, 22% of the Croatian adult population is obese.\",\"question\":\"How many Doctors of Medicines are not specialists?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}