{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"83440db8-866d-551d-90e4-37b3701a5d6c","task_key":"grid~5fmode--test--lgp~2dtest~2d6x6~2d15","task_revision_id":"1","upstream_id":"lgp-test-6x6-15","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Arnold`, `Carol`, `Bob`, `Peter`, `Alice`\\n - Each person lives in a unique style of house: `ranch`, `victorian`, `modern`, `colonial`, `craftsman`, `mediterranean`\\n - Each person has a unique favorite drink: `coffee`, `water`, `root beer`, `tea`, `milk`, `boba tea`\\n - Each person has an occupation: `engineer`, `nurse`, `doctor`, `artist`, `lawyer`, `teacher`\\n - The people keep unique animals: `horse`, `fish`, `dog`, `cat`, `rabbit`, `bird`\\n - Each person has a favorite color: `red`, `purple`, `white`, `green`, `yellow`, `blue`\\n\\n## Clues:\\n1. The fish enthusiast is in the first house.\\n2. Carol is somewhere to the left of the person in a Mediterranean-style villa.\\n3. The bird keeper is the person who loves purple.\\n4. The person in a ranch-style home is the one who only drinks water.\\n5. The coffee drinker is not in the fourth house.\\n6. The person living in a colonial-style house and the boba tea drinker are next to each other.\\n7. The cat lover is the person who is a teacher.\\n8. The person in a modern-style house is in the third house.\\n9. The person who is an engineer and Peter are next to each other.\\n10. Arnold is the person who is an artist.\\n11. The person whose favorite color is red is Arnold.\\n12. The coffee drinker is somewhere to the right of the person who is a teacher.\\n13. The bird keeper is the person in a ranch-style home.\\n14. The rabbit owner is in the sixth house.\\n15. The boba tea drinker is Peter.\\n16. Eric is the cat lover.\\n17. The person who is a nurse is directly left of the person in a modern-style house.\\n18. The bird keeper is Carol.\\n19. There are two houses between the cat lover and the boba tea drinker.\\n20. Bob is the tea drinker.\\n21. The person residing in a Victorian house is the dog owner.\\n22. The person whose favorite color is green is in the fourth house.\\n23. The person who loves blue is the root beer lover.\\n24. The person who loves white is not in the sixth house.\\n25. Peter is the person who is a doctor.\\n\",\"size\":\"6*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}