{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7aa2f392-4e0f-529b-8857-4bc06a0ff2c1","task_key":"default--validation--03a6e743~2d3e1b~2d432b~2d80c9~2d66dc84d8a0a8","task_revision_id":"1","upstream_id":"03a6e743-3e1b-432b-80c9-66dc84d8a0a8","short_description":"Which of the \"Barkers Beauties\" models had the same length of employment, only…","config":"default","split":"validation","body":"{\"passage\":\"To help display its many prizes, the show has featured several models who were known, during Barkers time on the show, as \\\"Barkers Beauties\\\". Some longer-tenured Barkers Beauties included Kathleen Bradley (1990–2000), Holly Hallstrom (1977–1995), Dian Parkinson (1975–1993), and Janice Pennington (1972–2000). Pennington and Bradley were both dismissed from the program in 2000, allegedly because they had given testimony on Hallstroms behalf in the wrongful termination litigation she pursued against Barker and the show. Following the departures of Nikki Ziering, Heather Kozar and Claudia Jordan in the 2000s, producers decided to use a rotating cast of models (up to ten) until the middle of season 37, after which the show reverted to five regular models. Since March 2008, the models include Rachel Reynolds, Amber Lancaster and Gwendolyn Osbourne (who left in 2017); Manuela Arbeláez joined the cast in April 2009, replacing Brandi Sherwood and James OHalloran joined the cast in December 2014. Carey does not use a collective name for the models, but refers to them by name, hoping that the models will be able to use the show as a \\\"springboard\\\" to further their careers. In a change from previous policy, the models appearing on a given episode are named individually in the shows credits and are formally referred as \\\"The Price Is Right models\\\" when collectively grouped at events. Since season 37, the show often uses a guest model for certain prizes, often crossing over from another CBS property or come courtesy of the company providing the prize. Some such models have been male, especially for musical instruments, tools, trucks and motorcycles, and used in guest appearances during the Showcase. Owing to the traditionally female demographic of daytime television shows, along with the pregnancies of Reynolds and Osbourne, CBS announced that the game show would add a male model for a week during season 41, fitting with other countries with the franchise that have used an occasional male model. The show held an internet search for the man in an online competition that featured Michael G. Richards, the shows executive producer, Reynolds, Lancaster, Osbourne and Arbeláez serving as judges and mentors during the web series, narrated by Gray. Viewers selected the winner in October 2012. On October 5, 2012, CBS announced that the winner of the male model online competition was Robert Scott Wilson of Boston, Massachusetts. Wilson appeared as a model on episodes through April 15, 2014. This contest was scheduled to be repeated in 2014, with auditions taking place during the FIFA World Cup break between May and July 2014. On December 8, 2014, CBS announced that the winner of the second male model online competition was James OHalloran.\",\"question\":\"Which of the \\\"Barkers Beauties\\\" models had the same length of employment, only two years apart?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}