{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1637647b-9021-5075-8d3c-13abef92a8a6","task_key":"grid~5fmode--test--lgp~2dtest~2d6x6~2d1","task_revision_id":"1","upstream_id":"lgp-test-6x6-1","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Bob`, `Peter`, `Arnold`, `Eric`, `Alice`, `Carol`\\n - People have unique hair colors: `red`, `gray`, `auburn`, `blonde`, `brown`, `black`\\n - People have unique favorite book genres: `historical fiction`, `biography`, `romance`, `fantasy`, `mystery`, `science fiction`\\n - People have unique heights: `very short`, `very tall`, `tall`, `short`, `super tall`, `average`\\n - Each person has a unique level of education: `associate`, `doctorate`, `high school`, `trade school`, `bachelor`, `master`\\n - Each person has a unique favorite drink: `boba tea`, `milk`, `water`, `root beer`, `coffee`, `tea`\\n\\n## Clues:\\n1. The person with a doctorate and Bob are next to each other.\\n2. There is one house between Carol and the person who has black hair.\\n3. Peter is the person with a doctorate.\\n4. The person who loves science fiction books is Eric.\\n5. The one who only drinks water is the person who has an average height.\\n6. Alice is the person who loves mystery books.\\n7. The person who loves romance books is Bob.\\n8. The person who has brown hair is in the second house.\\n9. The person who has an average height is in the fourth house.\\n10. The boba tea drinker is the person who is very tall.\\n11. The person with a high school diploma is Bob.\\n12. The person who is short is somewhere to the left of the person who is super tall.\\n13. The person who loves historical fiction books and the person with a bachelor's degree are next to each other.\\n14. The person who attended trade school is the person who has red hair.\\n15. Carol is the person who has auburn hair.\\n16. The person who is very short is somewhere to the right of the person who has gray hair.\\n17. There are two houses between Eric and the person who loves fantasy books.\\n18. There are two houses between the tea drinker and the person who is very short.\\n19. Eric is somewhere to the left of the person with a bachelor's degree.\\n20. The root beer lover is Alice.\\n21. The person with an associate's degree is Arnold.\\n22. The person who is tall is not in the second house.\\n23. The person who loves science fiction books is the boba tea drinker.\\n24. The person who has black hair is not in the fourth house.\\n25. The person who is short is the coffee drinker.\\n26. The coffee drinker and the person with a high school diploma are next to each other.\\n27. The coffee drinker is not in the second house.\\n\",\"size\":\"6*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}