{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c63df069-cb69-5b8e-b63e-6c80739723c2","task_key":"default--validation--4789a862~2d3100~2d406b~2d857a~2d618879434699","task_revision_id":"1","upstream_id":"4789a862-3100-406b-857a-618879434699","short_description":"In what year did Pillay play in both the Olympics and a Champions Trophies?","config":"default","split":"validation","body":"{\"passage\":\"Dhanraj Pillay, whose career spanned from December 1989 to August 2004, played 339 international matches. The Indian Hockey Federation did not keep official statistics for the goals scored. There is no credible information on the number of International goals scored by Dhanraj. He scored around 170 goals in his career, according to both him and leading statisticians in the world. He is the only player to have played in four Olympics (1992, 1996, 2000, and 2004), four World Cups (1990, 1994, 1998, and 2002), four Champions Trophies (1995, 1996, 2002, and 2003), and four Asian Games (1990, 1994, 1998, and 2002). India won the Asian Games (1998) and Asia Cup (2003) under his captaincy. He was also the highest goal scorer in the Bangkok Asian Games and was the only Indian player to figure in the World Eleven side during the 1994 World Cup at Sydney.\",\"question\":\"In what year did Pillay play in both the Olympics and a Champions Trophies?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}