{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"781d5dcf-4570-5700-8477-48abe33c5900","task_key":"default--validation--2dcfb4b6~2ddb43~2d4a09~2dbb5e~2dee646d5a0003","task_revision_id":"1","upstream_id":"2dcfb4b6-db43-4a09-bb5e-ee646d5a0003","short_description":"How many more wins did Cheryl Miller have than losses in her 78-70 score?","config":"default","split":"validation","body":"{\"passage\":\"Cooper was selected to represent the US at the inaugural Goodwill games, held in Moscow in July 1986. North Carolina States Kay Yow served as head coach. The team opened up with a 72–53 win over Yugoslavia, and followed that with a 21-point win over Brazil 91–70.  The third game was against Czechoslovakia and would be much closer. Cheryl Miller was the scoring leader in this game, scoring 26 points to help the US to a 78–70 victory.  The US faced Bulgaria in the semi-final match up, and again won, this time 67–58. This set up the final against the Soviet Union, led by 7-foot-2 Ivilana Semenova, considered the most dominant player in the world. The Soviet team, had a 152–2 record in major international competition over the prior three decades, including an 84–82 win over the US in the 1983 World Championships. The Soviets held the early edge, leading 21–19 at one time, before the US went on a scoring run to take a large lead they did not relinquish.  The final score was 83–60 in favor of the USA, earning the gold medal for the US squad.  Cooper  averaged 2.0 points per game.\",\"question\":\"How many more wins did Cheryl Miller have than losses in her 78-70 score?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}