{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70f69fca-d8ac-5846-9f6a-e782526e5772","task_key":"default--validation--02386f77~2d66ce~2d4d58~2d8286~2d4603e86bece9","task_revision_id":"1","upstream_id":"02386f77-66ce-4d58-8286-4603e86bece9","short_description":"Which happened last, the Second Hungarian Republic was established, or Hungary…","config":"default","split":"validation","body":"{\"passage\":\"The Kingdom of Hungary , also known as the Regency, existed from 1920 to 1946 as a de factonote 1 country under Regent Miklós Horthy. Horthy officially represented the Hungarian monarchy of Charles IV, Apostolic King of Hungary. Attempts by Charles IV to return to the throne were prevented by threats of war from neighbouring countries and by the lack of support from Horthy. The country has been regarded by some historians to have been a client state of Germany from 1938 to 1944. The Kingdom of Hungary under Horthy was an Axis Power during most of World War II.  In 1944, after Horthy's government negotiated secretly with the Allies, and considered to leave the war as well, Hungary was occupied by Nazi Germany and Horthy was deposed. The Arrow Cross Party's leader Ferenc Szálasi established a new Nazi-backed government, effectively turning Hungary into a German-occupied puppet state. After World War II, Hungary fell within the Soviet Union's sphere of interest. In 1946, the Second Hungarian Republic was established under Soviet influence. In 1949, the communist Hungarian People's Republic was founded.\",\"question\":\"Which happened last, the Second Hungarian Republic was established, or Hungary being occupied by Nazi Germany and Horthy was deposed?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}