{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a62e7326-652b-5985-a64c-483ce1cf3cff","task_key":"grid~5fmode--test--lgp~2dtest~2d5x6~2d26","task_revision_id":"1","upstream_id":"lgp-test-5x6-26","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Alice`, `Eric`, `Bob`, `Peter`, `Arnold`\\n - People have unique favorite book genres: `fantasy`, `mystery`, `science fiction`, `biography`, `romance`\\n - The mothers' names in different houses are unique: `Holly`, `Penny`, `Aniya`, `Kailyn`, `Janelle`\\n - People use unique phone models: `oneplus 9`, `iphone 13`, `samsung galaxy s21`, `google pixel 6`, `huawei p50`\\n - The people are of nationalities: `dane`, `brit`, `german`, `swede`, `norwegian`\\n - Each person lives in a unique style of house: `ranch`, `modern`, `craftsman`, `victorian`, `colonial`\\n\\n## Clues:\\n1. The person in a ranch-style home is somewhere to the right of the person residing in a Victorian house.\\n2. The Dane and the person who uses a Samsung Galaxy S21 are next to each other.\\n3. The person who uses a Google Pixel 6 is not in the second house.\\n4. There are two houses between the person who loves fantasy books and the person in a modern-style house.\\n5. The person whose mother's name is Kailyn is the Swedish person.\\n6. The Swedish person is Arnold.\\n7. The British person is somewhere to the left of the person who uses an iPhone 13.\\n8. The Dane is The person whose mother's name is Penny.\\n9. The person who uses a Samsung Galaxy S21 is the Norwegian.\\n10. The Norwegian is The person whose mother's name is Holly.\\n11. The person who loves fantasy books is Bob.\\n12. Alice is directly left of the Swedish person.\\n13. The person who loves romance books is Arnold.\\n14. The person who loves science fiction books is Peter.\\n15. The person whose mother's name is Aniya is directly left of the person who loves science fiction books.\\n16. The person who loves science fiction books is the person who uses a OnePlus 9.\\n17. The person residing in a Victorian house is the person who loves biography books.\\n18. The person who loves fantasy books is somewhere to the left of the German.\\n19. The person who uses an iPhone 13 is the person in a Craftsman-style house.\\n\",\"size\":\"5*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}