{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be355c96-781f-5a02-9a24-6184fd1ee36c","task_key":"default--validation--88a9a257~2dc601~2d4392~2daaa3~2d3b530a02571c","task_revision_id":"1","upstream_id":"88a9a257-c601-4392-aaa3-3b530a02571c","short_description":"Did the Libyan Army have more commando battalions or Mechanized Infantry…","config":"default","split":"validation","body":"{\"passage\":\"In 2009, the Libyan Army (1951-2011) consisted of 25,000 volunteers with an additional 25,000 conscripts (total 50,000). At that time, the army was organised into 11 Border Defence and 4 Security Zones, one regime security brigade, 10 Tank Battalions, 10 Mechanized Infantry Battalions, 18 Infantry Battalions, 6 Commando Battalions, 22 Artillery Battalions, 4 SSM Brigade and 7 Air Defence Artillery Battalions. Khamis Gaddafis 32nd Brigade was one of the main regime protection forces. The Khamis Brigade was considered by US diplomats in 2009 as the most capable of defending the regime. In addition, the Revolutionary Guard Corps also served as a brigade-sized protection force for Gaddafi. In 2009, it emerged that a British Special Air Service team were training Libyan special forces. Under Gaddafi, conscription was listed as 18 months.\",\"question\":\"Did the Libyan Army have more commando battalions or Mechanized Infantry Battalions?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}