{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ac53547-d56d-5c62-97fd-07bf5cd70a87","task_key":"grid~5fmode--test--lgp~2dtest~2d6x5~2d15","task_revision_id":"1","upstream_id":"lgp-test-6x5-15","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Arnold`, `Alice`, `Carol`, `Peter`, `Bob`, `Eric`\\n - The people keep unique animals: `fish`, `bird`, `rabbit`, `cat`, `horse`, `dog`\\n - Each person has a unique favorite drink: `tea`, `root beer`, `water`, `milk`, `boba tea`, `coffee`\\n - People use unique phone models: `iphone 13`, `google pixel 6`, `samsung galaxy s21`, `huawei p50`, `xiaomi mi 11`, `oneplus 9`\\n - Each mother is accompanied by their child: `Alice`, `Fred`, `Meredith`, `Samantha`, `Timothy`, `Bella`\\n\\n## Clues:\\n1. The tea drinker is the person who uses an iPhone 13.\\n2. There is one house between the dog owner and the tea drinker.\\n3. The fish enthusiast is somewhere to the left of the tea drinker.\\n4. Eric and the person's child is named Alice are next to each other.\\n5. The one who only drinks water is not in the third house.\\n6. The root beer lover is directly left of the person's child is named Samantha.\\n7. The person who is the mother of Timothy is the coffee drinker.\\n8. The fish enthusiast is directly left of the person who likes milk.\\n9. Peter is the person who likes milk.\\n10. The person who uses a OnePlus 9 is directly left of the person's child is named Alice.\\n11. The person who keeps horses is not in the third house.\\n12. The person's child is named Meredith is directly left of Bob.\\n13. The person's child is named Bella is the person who uses a Google Pixel 6.\\n14. The bird keeper is directly left of the person's child is named Meredith.\\n15. The person who uses a Samsung Galaxy S21 is directly left of the person's child is named Bella.\\n16. The one who only drinks water is somewhere to the left of the person's child is named Fred.\\n17. Arnold is the tea drinker.\\n18. The person who keeps horses is somewhere to the left of the cat lover.\\n19. The person who uses a Huawei P50 and Alice are next to each other.\\n20. Bob is directly left of the root beer lover.\\n21. The person who is the mother of Timothy is Eric.\\n\",\"size\":\"6*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}