{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ae08161-a7ef-597b-84fe-afb5d45b2995","task_key":"grid~5fmode--test--lgp~2dtest~2d6x6~2d39","task_revision_id":"1","upstream_id":"lgp-test-6x6-39","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Arnold`, `Bob`, `Alice`, `Eric`, `Peter`, `Carol`\\n - People have unique favorite sports: `volleyball`, `soccer`, `basketball`, `baseball`, `swimming`, `tennis`\\n - Each person has a unique hobby: `gardening`, `cooking`, `painting`, `woodworking`, `knitting`, `photography`\\n - Each mother is accompanied by their child: `Bella`, `Meredith`, `Alice`, `Samantha`, `Fred`, `Timothy`\\n - Each person has a unique birthday month: `feb`, `jan`, `mar`, `may`, `sept`, `april`\\n - Everyone has something unique for lunch: `stir fry`, `grilled cheese`, `pizza`, `spaghetti`, `stew`, `soup`\\n\\n## Clues:\\n1. The person who loves soccer is somewhere to the right of Eric.\\n2. The person who paints as a hobby is somewhere to the left of the woodworking hobbyist.\\n3. The person whose birthday is in February is not in the third house.\\n4. The person who is the mother of Timothy is directly left of Arnold.\\n5. The person who loves cooking is somewhere to the left of the person's child is named Fred.\\n6. Alice is the person who paints as a hobby.\\n7. The person's child is named Alice is the person who loves cooking.\\n8. The person whose birthday is in March is the person's child is named Samantha.\\n9. The person who loves the soup is the person whose birthday is in May.\\n10. Carol is somewhere to the right of the person whose birthday is in May.\\n11. The person whose birthday is in March and the person who is a pizza lover are next to each other.\\n12. The person whose birthday is in February is not in the fourth house.\\n13. There are two houses between the person who loves baseball and the person who loves the stew.\\n14. The person whose birthday is in May is somewhere to the left of the person who loves volleyball.\\n15. The person whose birthday is in January is somewhere to the right of Arnold.\\n16. The person who loves cooking is not in the third house.\\n17. The person who enjoys knitting is the person whose birthday is in September.\\n18. The person who enjoys gardening is the person's child is named Meredith.\\n19. The person who is a pizza lover is the person who loves swimming.\\n20. There is one house between the person who loves basketball and the person whose birthday is in May.\\n21. The person who loves the soup is directly left of the person who loves the spaghetti eater.\\n22. The person who loves the stew is the person's child is named Bella.\\n23. The person who enjoys knitting is somewhere to the left of the person who loves the soup.\\n24. Bob is somewhere to the left of the person who loves the stew.\\n25. Arnold is the person who loves stir fry.\\n26. The woodworking hobbyist is directly left of the person who loves the soup.\\n\",\"size\":\"6*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}