{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4dca0552-5a54-5a29-bd00-a6994fc3e88f","task_key":"default--validation--9562e467~2ddfc2~2d4fb8~2dbfd0~2d89f6079096af","task_revision_id":"1","upstream_id":"9562e467-dfc2-4fb8-bfd0-89f6079096af","short_description":"Who ate more bunless hotdogs in the 2003 show Man vs. Beast, the Kodiak bear or…","config":"default","split":"validation","body":"{\"passage\":\"In the 2006 Krystal Square Off, Kobayashis mark of 97 hamburgers was 30 better than his winning total in 2005 and 28 better than the World Record he set in 2004. At a speed-eating contest in Hong Kong on August 13, 2005, Kobayashi consumed 83 vegetarian jiaozi dumplings in 8 minutes. The next day, he ate 100 baozi in 12 minutes. Kobayashi also won the 2005 Alka-Seltzer US Open of Competitive Eating, a three-hour IFOCE elimination tournament on ESPN, as well as the Glutton Bowl, a two-hour IFOCE eating special that aired on the Fox Network in 2002. However, on Foxs 2003 show Man vs. Beast, Kobayashi lost in an eating competition against a 1089-pound (494 kg) Kodiak bear, when he ate 31 bunless hot dogs in 2 minutes and 36 seconds to the bears 50. In a 2014 interview, Kobayashi claims to have beaten the bear in the rehearsal. (In October 2012, Kobayashi broke the record held by the bear at the Texas state fair.)\",\"question\":\"Who ate more bunless hotdogs in the 2003 show Man vs. Beast, the Kodiak bear or Kobayashi?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}