{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cdcd0324-7508-5f39-8520-c50cb6de7699","task_key":"grid~5fmode--test--lgp~2dtest~2d5x6~2d8","task_revision_id":"1","upstream_id":"lgp-test-5x6-8","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Peter`, `Arnold`, `Bob`, `Alice`\\n - Each person lives in a unique style of house: `modern`, `craftsman`, `ranch`, `victorian`, `colonial`\\n - The mothers' names in different houses are unique: `Penny`, `Kailyn`, `Holly`, `Janelle`, `Aniya`\\n - People use unique phone models: `oneplus 9`, `google pixel 6`, `huawei p50`, `iphone 13`, `samsung galaxy s21`\\n - Each person has a unique favorite drink: `coffee`, `water`, `root beer`, `tea`, `milk`\\n - The people keep unique animals: `fish`, `dog`, `horse`, `bird`, `cat`\\n\\n## Clues:\\n1. The person who uses a Google Pixel 6 is not in the first house.\\n2. The one who only drinks water is Alice.\\n3. The person living in a colonial-style house is somewhere to the right of the person who uses a Huawei P50.\\n4. The person who keeps horses is the person who uses a OnePlus 9.\\n5. The person in a ranch-style home is The person whose mother's name is Kailyn.\\n6. The root beer lover is the cat lover.\\n7. The person living in a colonial-style house is not in the fourth house.\\n8. The bird keeper is in the fourth house.\\n9. The tea drinker is Bob.\\n10. The tea drinker is somewhere to the right of The person whose mother's name is Kailyn.\\n11. The root beer lover is somewhere to the left of The person whose mother's name is Kailyn.\\n12. The person who keeps horses is the person in a modern-style house.\\n13. The person who uses an iPhone 13 is the person who likes milk.\\n14. The dog owner is the person who likes milk.\\n15. The person who uses a Google Pixel 6 is the person in a Craftsman-style house.\\n16. Eric is not in the second house.\\n17. The tea drinker is in the fourth house.\\n18. The person who keeps horses is in the third house.\\n19. The person in a modern-style house is The person whose mother's name is Penny.\\n20. The root beer lover is Peter.\\n21. The person whose mother's name is Aniya is not in the fourth house.\\n22. The person whose mother's name is Janelle is the one who only drinks water.\\n\",\"size\":\"5*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}