{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c9ec65d0-ef9c-5a6e-a9aa-dcddd8d16ef2","task_key":"grid~5fmode--test--lgp~2dtest~2d6x6~2d36","task_revision_id":"1","upstream_id":"lgp-test-6x6-36","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Arnold`, `Bob`, `Peter`, `Alice`, `Carol`\\n - People have unique heights: `very tall`, `tall`, `average`, `short`, `super tall`, `very short`\\n - Each person has a unique birthday month: `sept`, `may`, `jan`, `april`, `feb`, `mar`\\n - People have unique hair colors: `blonde`, `red`, `black`, `auburn`, `gray`, `brown`\\n - People have unique favorite book genres: `science fiction`, `romance`, `biography`, `mystery`, `fantasy`, `historical fiction`\\n - Each person has a unique type of pet: `bird`, `hamster`, `fish`, `dog`, `cat`, `rabbit`\\n\\n## Clues:\\n1. The person with an aquarium of fish is the person who loves mystery books.\\n2. The person who has black hair is the person who owns a dog.\\n3. The person who has gray hair is the person who loves science fiction books.\\n4. The person who loves historical fiction books is somewhere to the left of the person who has black hair.\\n5. The person who loves historical fiction books is directly left of the person who owns a rabbit.\\n6. The person whose birthday is in February is the person who owns a dog.\\n7. Bob is the person who keeps a pet bird.\\n8. The person who keeps a pet bird is the person who loves romance books.\\n9. Alice is directly left of the person who loves fantasy books.\\n10. The person who owns a rabbit is directly left of the person who is very short.\\n11. The person who is short is somewhere to the left of the person who is super tall.\\n12. The person who has an average height is in the sixth house.\\n13. The person who has red hair is not in the first house.\\n14. The person who is very tall is somewhere to the right of the person who is super tall.\\n15. There are two houses between the person who loves romance books and Eric.\\n16. The person with an aquarium of fish is in the sixth house.\\n17. The person who has blonde hair is the person who loves historical fiction books.\\n18. The person who is tall is somewhere to the right of the person whose birthday is in February.\\n19. The person who has auburn hair is Carol.\\n20. The person with an aquarium of fish is the person whose birthday is in March.\\n21. The person who loves science fiction books is directly left of the person with an aquarium of fish.\\n22. The person whose birthday is in September is not in the first house.\\n23. The person who loves biography books is directly left of the person who has a cat.\\n24. The person whose birthday is in January is the person who loves science fiction books.\\n25. Arnold is the person whose birthday is in May.\\n\",\"size\":\"6*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}