{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"aaef1b76-c9e7-5c00-b07c-d0830b3c8665","task_key":"grid~5fmode--test--lgp~2dtest~2d5x6~2d28","task_revision_id":"3","upstream_id":"lgp-test-5x6-28","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Alice`, `Eric`, `Peter`, `Bob`, `Arnold`\\n - People have unique favorite sports: `soccer`, `baseball`, `swimming`, `tennis`, `basketball`\\n - Each person lives in a unique style of house: `modern`, `victorian`, `colonial`, `craftsman`, `ranch`\\n - Each person prefers a unique type of vacation: `beach`, `city`, `cruise`, `mountain`, `camping`\\n - Each person has an occupation: `artist`, `engineer`, `lawyer`, `doctor`, `teacher`\\n - The mothers' names in different houses are unique: `Penny`, `Aniya`, `Janelle`, `Holly`, `Kailyn`\\n\\n## Clues:\\n1. There is one house between The person whose mother's name is Janelle and Eric.\\n2. Arnold is not in the fifth house.\\n3. The person whose mother's name is Janelle is Peter.\\n4. The person who enjoys mountain retreats is The person whose mother's name is Holly.\\n5. The person whose mother's name is Aniya is the person in a modern-style house.\\n6. The person who likes going on cruises is The person whose mother's name is Kailyn.\\n7. The person who prefers city breaks is the person living in a colonial-style house.\\n8. The person who loves soccer is The person whose mother's name is Holly.\\n9. The person who is an artist is Eric.\\n10. The person who is a doctor is in the second house.\\n11. The person who is a teacher is somewhere to the left of the person in a modern-style house.\\n12. The person whose mother's name is Penny is not in the second house.\\n13. The person in a ranch-style home is in the third house.\\n14. The person who loves swimming is The person whose mother's name is Kailyn.\\n15. Arnold is not in the third house.\\n16. The person who loves swimming is in the fourth house.\\n17. The person who loves baseball and the person who prefers city breaks are next to each other.\\n18. The person who loves basketball is somewhere to the left of the person who loves soccer.\\n19. Bob is somewhere to the left of the person in a modern-style house.\\n20. The person who enjoys camping trips is in the fifth house.\\n21. The person in a Craftsman-style house is the person who is an engineer.\\n22. There are two houses between the person living in a colonial-style house and the person in a modern-style house.\\n\",\"size\":\"5*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}