{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"33daaadc-ef98-5161-a930-ad57d66cd81f","task_key":"grid~5fmode--test--lgp~2dtest~2d6x3~2d13","task_revision_id":"1","upstream_id":"lgp-test-6x3-13","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Bob`, `Arnold`, `Carol`, `Alice`, `Peter`, `Eric`\\n - People have unique favorite book genres: `romance`, `historical fiction`, `biography`, `mystery`, `fantasy`, `science fiction`\\n - Each person has an occupation: `artist`, `doctor`, `nurse`, `engineer`, `teacher`, `lawyer`\\n\\n## Clues:\\n1. Alice is the person who loves fantasy books.\\n2. The person who loves mystery books and Bob are next to each other.\\n3. Carol is the person who loves mystery books.\\n4. The person who is a lawyer is the person who loves fantasy books.\\n5. Bob is not in the fifth house.\\n6. Arnold is somewhere to the left of the person who is an engineer.\\n7. The person who is a nurse is directly left of Alice.\\n8. The person who loves biography books is the person who is a teacher.\\n9. The person who loves historical fiction books is somewhere to the left of the person who is a teacher.\\n10. The person who is a doctor is in the first house.\\n11. The person who loves science fiction books is the person who is an artist.\\n12. Eric is in the third house.\\n13. The person who loves mystery books is not in the fifth house.\\n\",\"size\":\"6*3\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}