{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"05867546-6bd9-5511-89ee-12534fb1a9a3","task_key":"grid~5fmode--test--lgp~2dtest~2d5x5~2d34","task_revision_id":"1","upstream_id":"lgp-test-5x5-34","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Peter`, `Eric`, `Arnold`, `Bob`, `Alice`\\n - Each person has a unique type of pet: `fish`, `dog`, `cat`, `bird`, `hamster`\\n - People have unique hair colors: `black`, `red`, `gray`, `blonde`, `brown`\\n - People have unique heights: `tall`, `very tall`, `very short`, `short`, `average`\\n - The mothers' names in different houses are unique: `Janelle`, `Penny`, `Holly`, `Aniya`, `Kailyn`\\n\\n## Clues:\\n1. The person who has red hair is the person who keeps a pet bird.\\n2. The person whose mother's name is Kailyn is Eric.\\n3. There is one house between the person who has gray hair and the person who has a cat.\\n4. The person whose mother's name is Janelle is Peter.\\n5. The person who is tall is directly left of The person whose mother's name is Janelle.\\n6. The person who has an average height is directly left of the person who has brown hair.\\n7. The person whose mother's name is Kailyn is the person who is very short.\\n8. The person who is very tall is somewhere to the right of The person whose mother's name is Janelle.\\n9. The person whose mother's name is Penny is in the first house.\\n10. The person with a pet hamster is in the first house.\\n11. The person who is tall is the person with an aquarium of fish.\\n12. The person whose mother's name is Kailyn is somewhere to the left of The person whose mother's name is Aniya.\\n13. The person who owns a dog is in the fifth house.\\n14. The person whose mother's name is Kailyn is directly left of the person who has black hair.\\n15. Bob is somewhere to the left of the person with an aquarium of fish.\\n16. The person who keeps a pet bird is directly left of Arnold.\\n\",\"size\":\"5*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}