{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cfe42238-8220-5765-a62a-417799a8d289","task_key":"grid~5fmode--test--lgp~2dtest~2d6x6~2d30","task_revision_id":"1","upstream_id":"lgp-test-6x6-30","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Bob`, `Alice`, `Arnold`, `Carol`, `Peter`\\n - The people are of nationalities: `swede`, `norwegian`, `german`, `chinese`, `dane`, `brit`\\n - They all have a unique favorite flower: `daffodils`, `roses`, `carnations`, `lilies`, `tulips`, `iris`\\n - Each person has a unique favorite drink: `water`, `tea`, `root beer`, `coffee`, `boba tea`, `milk`\\n - Each person has a favorite color: `green`, `blue`, `purple`, `red`, `yellow`, `white`\\n - Each person has a unique level of education: `high school`, `associate`, `bachelor`, `doctorate`, `trade school`, `master`\\n\\n## Clues:\\n1. Arnold is somewhere to the left of the person who loves a carnations arrangement.\\n2. The coffee drinker is the person who loves the vase of tulips.\\n3. The German is directly left of the one who only drinks water.\\n4. The person whose favorite color is green is Alice.\\n5. The person who loves white is the coffee drinker.\\n6. The coffee drinker is the person with a bachelor's degree.\\n7. The one who only drinks water is the person who loves purple.\\n8. The person who loves a bouquet of daffodils is the person who loves blue.\\n9. The tea drinker is directly left of the person who loves a carnations arrangement.\\n10. The person with a high school diploma is Carol.\\n11. There is one house between the person who loves the boquet of iris and Peter.\\n12. The person with an associate's degree is the person whose favorite color is green.\\n13. Arnold is the Chinese.\\n14. The person whose favorite color is red is in the third house.\\n15. The boba tea drinker and the person who loves the vase of tulips are next to each other.\\n16. Alice is directly left of the Swedish person.\\n17. There is one house between the British person and the Chinese.\\n18. The person who loves the rose bouquet is somewhere to the left of the person with a bachelor's degree.\\n19. The person who loves yellow is not in the first house.\\n20. There are two houses between the person who likes milk and Peter.\\n21. Bob is the person with a master's degree.\\n22. The Swedish person is the person with a master's degree.\\n23. The person who attended trade school is somewhere to the left of the Chinese.\\n24. The German is in the fifth house.\\n25. The Norwegian is the one who only drinks water.\\n\",\"size\":\"6*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}