{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a498f63b-1da9-5e7a-8c3b-e09524114d35","task_key":"default--validation--a791a161~2d0f48~2d444f~2d9650~2d51346300a7d0","task_revision_id":"1","upstream_id":"a791a161-0f48-444f-9650-51346300a7d0","short_description":"How many more years did I Love Lucy run as a sitcom on TV than Leave It To…","config":"default","split":"validation","body":"{\"passage\":\"Sitcoms offered a romanticized view of middle class American life with The Adventures of Ozzie and Harriet (1952–1966), Father Knows Best (1954–1960), and American Broadcasting Companys The Donna Reed Show (1958–1966) exemplifying the genre. Emmy Award-winning comedy I Love Lucy (1951–1960) starred husband and wife Desi Arnaz and Lucille Ball and enjoyed such popularity that some businesses closed early on Monday nights in order to allow employees to hurry home for the show. In The Life of Riley (1953–1958), blue collar Chester A. Riley (William Bendix) became the prototype for a long line of bumbling television patriarchs that included Fred Flintstone and Archie Bunker. The shows first incarnation for the DuMont Television Network lasted a season (1949–1950) and won an Emmy during the first Emmy Awards in 1949. The Honeymooners (1955–1956) followed bus driver Ralph Kramden (Jackie Gleason) and his sewer-working sidekick Ed Norton (Art Carney) while archetypal suburban life was limned in Leave It to Beaver (1957–1963), purportedly the first sitcom to be told from a childs point of view and the first to strike a blow for television realism by displaying a toilet in an early episode. Genre series were popular with Dragnet (series) (1952) starring Jack Webb representing police procedural drama, British television syndication series The Adventures of Robin Hood (TV series) (1955) starring Richard Greene representing historical drama, and Gunsmoke (1955) with James Arness and Amanda Blake representing the western. Mid-decade, Warner Bros. produced a group of five westerns with Maverick (TV series) starring James Garner and Cheyenne (1955 TV series) starring Clint Walker leading the group in popularity.\",\"question\":\"How many more years did I Love Lucy run as a sitcom on TV than Leave It To Beaver Beaver?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}