{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bce6c9bd-d103-56ed-9b59-3a2f9e55b8d3","task_key":"default--validation--d5a43b55~2dae05~2d40c0~2d975f~2dcddc3d5a216a","task_revision_id":"1","upstream_id":"d5a43b55-ae05-40c0-975f-cddc3d5a216a","short_description":"How many more wins than starts did Steve Sinclair have?","config":"default","split":"validation","body":"{\"passage\":\"In 1994, the Suns reached the playoffs for the first time since 1991. On offense, the team was led by former first round draft choice Shannon Stewart (baseball). Stewart hit .324 with 4 home runs and 25 RBI in an injury-shortened season. Tom Evans (baseball) returned from the 1993 squad, hitting .273 with 13 home runs and 48 RBI in 95 games. The power was supplied by Lorenzo Delacruz and Ryan Jones, who hit 19 and 18 home runs, respectively. Jones also had a team leading 72 RBI. Edwin Hurtado went 11–2 with a 2.95 ERA in 33 games, 16 of which were starts. The bullpen was headlined by Steve Sinclair and Dave Sinnes. Sinclair appeared in 37 games out of the bullpen and picked up a total of 9 wins with 105 innings pitched. Sinclair only made one start for the Suns all year. Closer Sinnes tied for the South Atlantic League lead with 37 saves. The Suns advanced to the league championship. However, the Savannah Sand Gnats beat the Suns to win their second straight championship.\",\"question\":\"How many more wins than starts did Steve Sinclair have?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}