{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"bbe27aad-c1ac-514e-928a-989d441cdc81","task_key":"grid~5fmode--test--lgp~2dtest~2d5x6~2d0","task_revision_id":"3","upstream_id":"lgp-test-5x6-0","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Arnold`, `Bob`, `Alice`, `Eric`, `Peter`\\n - People have unique favorite sports: `basketball`, `soccer`, `tennis`, `baseball`, `swimming`\\n - The people keep unique animals: `dog`, `fish`, `horse`, `bird`, `cat`\\n - People use unique phone models: `oneplus 9`, `google pixel 6`, `samsung galaxy s21`, `iphone 13`, `huawei p50`\\n - People have unique hair colors: `black`, `red`, `brown`, `blonde`, `gray`\\n - Each person lives in a unique style of house: `modern`, `craftsman`, `victorian`, `ranch`, `colonial`\\n\\n## Clues:\\n1. The person who has gray hair is the person who loves tennis.\\n2. The person in a ranch-style home is in the fourth house.\\n3. The person living in a colonial-style house is the person who loves swimming.\\n4. The dog owner is somewhere to the right of the person who has gray hair.\\n5. The fish enthusiast is the person who has gray hair.\\n6. The person who has black hair is not in the fifth house.\\n7. The person who uses a Samsung Galaxy S21 is the bird keeper.\\n8. There is one house between the fish enthusiast and the person who uses a Samsung Galaxy S21.\\n9. The person residing in a Victorian house is somewhere to the left of the person in a Craftsman-style house.\\n10. The person who has red hair is not in the fifth house.\\n11. There is one house between the person who uses a Samsung Galaxy S21 and the person who uses a Huawei P50.\\n12. The person who uses an iPhone 13 is the person in a Craftsman-style house.\\n13. Eric is the person who has red hair.\\n14. The person who has red hair is not in the fourth house.\\n15. The person who uses a OnePlus 9 is in the first house.\\n16. The person who loves soccer is the dog owner.\\n17. The person who keeps horses is Bob.\\n18. Arnold is the fish enthusiast.\\n19. The person who loves baseball is Peter.\\n20. The person who loves soccer is in the fourth house.\\n21. The person who has blonde hair is directly left of the person who has black hair.\\n\",\"size\":\"5*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}