{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a6cd88f8-d63d-5398-878d-e9ada7e39835","task_key":"default--validation--4541e6e0~2db57a~2d4b56~2dba8a~2d33ba52b0d0c8","task_revision_id":"1","upstream_id":"4541e6e0-b57a-4b56-ba8a-33ba52b0d0c8","short_description":"How many days did Eta Carinae surpass Canopus in brightness?","config":"default","split":"validation","body":"{\"passage\":\"Eta Carinae was brighter still on January 2, 1838, equivalent to Alpha Centauri, before fading slightly over the following three months. Herschel did not observe the star after this, but received correspondence from the Reverend W.S. Mackay in Calcutta, who wrote in 1843, \\\"To my great surprise I observed this March last (1843), that the star Eta Argus had become a star of the first magnitude fully as bright as Canopus, and in colour and size very like Arcturus.\\\" Observations at the Cape of Good Hope indicated it peaked in brightness, surpassing Canopus, over March 11 to 14, 1843 before beginning to fade, then brightened to between the brightness of Alpha Centauri and Canopus between March 24 and 28 before fading once again. For much of 1844 the brightness was midway between Alpha Centauri and Beta Centauri, around magnitude +0.2, before brightening again at the end of the year. At its brightest in 1843 it likely reached an apparent magnitude of −0.8, then −1.0 in 1845. The peaks in 1827, 1838, and 1843 are likely to have occurred at the periastron passage—the point the two stars are closest together—of the Binary star orbit. From 1845 to 1856, the brightness decreased by around 0.1 magnitudes per year, but with possible rapid and large fluctuations.\",\"question\":\"How many days did Eta Carinae surpass Canopus in brightness?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}