{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45e62eea-893b-5d16-9364-36442bfb51ed","task_key":"default--validation--633ae12e~2dad7e~2d438a~2d826e~2d86e70bd6e9b6","task_revision_id":"1","upstream_id":"633ae12e-ad7e-438a-826e-86e70bd6e9b6","short_description":"the Japanese attack at Port Arthur was how many years before the Russian…","config":"default","split":"validation","body":"{\"passage\":\"Though there had been popular support for the war among the Russian public following the Japanese attack at Port Arthur in 1904, that popular support soon turned to discontent after suffering multiple defeats at the hands of the Japanese forces. For many Russians, the immediate shock of unexpected humiliation at the hands of Japan caused the conflict to be viewed as a metaphor for the shortcomings of the Romanov autocracy. Popular discontent in Russia after the war added more fuel to the already simmering Russian Revolution of 1905, an event Nicholas II had hoped to avoid entirely by taking intransigent negotiating stances prior to coming to the table. Twelve years later, that discontent boiled over into the February Revolution of 1917. In Poland, which Russia partitioned in the late 18th century, and where Russian rule already caused two major uprisings, the population was so restless that an army of 250,000-300,000—larger than the one facing the Japanese—had to be stationed to put down the unrest. Some political leaders of the Polish insurrection movement  sent emissaries to Japan to collaborate on sabotage and intelligence gathering within the Russian Empire and even plan a Japanese-aided uprising. In Russia, the defeat of 1905 led in the short term to a reform of the Russian military that allowed it to face Germany in World War I. However, the revolts at home following the war planted seeds that presaged the Russian Revolution of 1917. This was because Tsar Nicholas II issued the October Manifesto, which included only limited reforms such as the Duma and failed to address the societal problems of Russia at the time.\",\"question\":\"the Japanese attack at Port Arthur was how many years before the Russian Revolution of 1905?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}