{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"c276c5b5-e24e-5439-af9c-de47ddc42603","task_key":"grid~5fmode--test--lgp~2dtest~2d6x5~2d14","task_revision_id":"3","upstream_id":"lgp-test-6x5-14","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Bob`, `Carol`, `Arnold`, `Peter`, `Alice`\\n - Everyone has a unique favorite cigar: `blends`, `prince`, `dunhill`, `yellow monster`, `blue master`, `pall mall`\\n - People have unique hair colors: `auburn`, `gray`, `blonde`, `black`, `red`, `brown`\\n - Each person has a unique favorite drink: `boba tea`, `root beer`, `water`, `tea`, `coffee`, `milk`\\n - Each person has an occupation: `artist`, `nurse`, `teacher`, `doctor`, `engineer`, `lawyer`\\n\\n## Clues:\\n1. Bob is the tea drinker.\\n2. The Dunhill smoker is not in the second house.\\n3. There is one house between Carol and Arnold.\\n4. The Prince smoker is the person who has black hair.\\n5. The person who has auburn hair is not in the third house.\\n6. Arnold is in the fourth house.\\n7. The Prince smoker is not in the fourth house.\\n8. The person who is an artist is the person partial to Pall Mall.\\n9. The person who is an engineer is directly left of the root beer lover.\\n10. The boba tea drinker is the person who has brown hair.\\n11. The person who is a lawyer is in the fifth house.\\n12. The person who is an engineer is the person who smokes Blue Master.\\n13. The person who likes milk is the person who has auburn hair.\\n14. Alice is somewhere to the left of the person who is a teacher.\\n15. The person who has blonde hair is the person who smokes Yellow Monster.\\n16. The person who has black hair is the person who is a doctor.\\n17. Arnold is somewhere to the right of the person who has gray hair.\\n18. The person who has auburn hair is not in the first house.\\n19. The one who only drinks water is the person who smokes many unique blends.\\n20. The person who smokes many unique blends is somewhere to the right of the person who has brown hair.\\n21. Arnold is the root beer lover.\\n22. The person who has brown hair is not in the third house.\\n23. The person who smokes many unique blends is somewhere to the left of Peter.\\n24. The person who likes milk is somewhere to the left of the person who has blonde hair.\\n\",\"size\":\"6*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}