{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac1cc351-c6f3-5fdd-b1c5-151aed891f15","task_key":"default--validation--1190d70f~2dfcec~2d4907~2da18f~2db754c19163d3","task_revision_id":"1","upstream_id":"1190d70f-fcec-4907-a18f-b754c19163d3","short_description":"Which start has a higher absolute magnitude, A-type star or B9-type star?","config":"default","split":"validation","body":"{\"passage\":\"Gamma Arietis, with a common name of Mesarthim, is a binary star with two white-hued components, located in a rich field of magnitude 8-12 stars. Its traditional name has conflicting derivations. It may be derived from a corruption of \\\"al-sharatan\\\", the Arabic word meaning \\\"pair\\\" or a word for \\\"fat ram\\\". However, it may also come from the Sanskrit for \\\"first star of Aries\\\" or the Hebrew for \\\"ministerial servants\\\", both of which are unusual languages of origin for star names. Along with Beta Arietis, it was known to the Bedouin as \\\"qarna al-hamal\\\". The primary is of magnitude 4.59 and the secondary is of magnitude 4.68. The system is 164 light-years from Earth. The two components are separated by 7.8 arcseconds, and the system as a whole has an apparent magnitude of 3.9. The primary has a luminosity of  and the secondary has a luminosity of ; the primary is an A-type star with an absolute magnitude of 0.2 and the secondary is a B9-type star with an absolute magnitude of 0.4. The angle between the two components is 1°. Mesarthim was discovered to be a double star by Robert Hooke in 1664, one of the earliest such telescopic discoveries. The primary, γ1 Arietis, is an Alpha² Canum Venaticorum variable star that has a range of 0.02 magnitudes and a period of 2.607 days. It is unusual because of its strong silicon emission lines.\",\"question\":\"Which start has a higher absolute magnitude, A-type star or B9-type star?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}