{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"298c95ff-1049-5c0e-93e5-c90a2daa5c5c","task_key":"default--validation--f1a403fb~2d38e9~2d4b55~2db8a5~2d5fe4ed209cc2","task_revision_id":"1","upstream_id":"f1a403fb-38e9-4b55-b8a5-5fe4ed209cc2","short_description":"How many countries did Edward use to get home in 1273?","config":"default","split":"validation","body":"{\"passage\":\"Following this victory, Edward realized that to create a force capable of retaking Jerusalem it would be necessary to end the internal unrest within the Christian state, and so he mediated between Hugh and his unenthusiastic knights from the Ibelin family of Cyprus.  In parallel to the mediation, Prince Edward and King Hugh began negotiating a truce with Sultan Baibars; a 10-year-10-month-and-10-day agreement was reached in May 1272, at Caesarea. Almost immediately Prince Edmund departed for England, while Edward remained to see if the treaty would hold. The following month, an attempt to assassinate Edward was made. Several versions of who sent the assassin exist. According to different versions, the assassin was sent by the emir of Ramlah or by Baibars. Some legends also say that the assassin was sent by the \\\"Old Man of the Mountains\\\", leader of a heretical Muslim sect. Edward killed the assassin but received a festering wound from a poisoned dagger in the process, further delaying Edward's own departure. In September 1272, Edward departed Acre for Sicily and, while recuperating on the island, he first received news of the death of his son John, and then a few months later news of the death of his father.  In 1273 Edward started his homeward journey via Italy, Gascony and Paris. Edward finally reached England in the middle of 1274, and was crowned King of England on 19 August 1274.\",\"question\":\"How many countries did Edward use to get home in 1273?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}