{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7eb7d5b3-a00e-5a9e-9dcb-91e32934470d","task_key":"default--validation--7eb7d5b3-a00e-5a9e-9dcb-91e32934470d","task_revision_id":"1","upstream_id":"","short_description":"was there more than one pharaoh at a time","config":"default","split":"validation","body":"{\"passage\":\"The kings of the 7th and 8th Dynasties, who represented the successors of the 6th Dynasty, tried to hold onto some power in Memphis but owed much of it to powerful nomarchs. After 20 to 45 years, they were overthrown by a new line of pharaohs based in Herakleopolis Magna. Some time after these events, a rival line based at Thebes revolted against their nomial Northern overlords and united Upper Egypt. Around 2055 BC, Mentuhotep II, the son and successor of pharaoh Intef III defeated the Herakleopolitan pharaohs and reunited the Two Lands, thereby starting the Middle Kingdom.\",\"question\":\"was there more than one pharaoh at a time\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}