{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9977ff44-e2fb-57ea-ba1b-4d5d67c7152f","task_key":"grid~5fmode--test--lgp~2dtest~2d6x3~2d12","task_revision_id":"1","upstream_id":"lgp-test-6x3-12","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Peter`, `Alice`, `Arnold`, `Eric`, `Carol`, `Bob`\\n - Each person has a unique favorite drink: `water`, `milk`, `root beer`, `tea`, `coffee`, `boba tea`\\n - Each person has an occupation: `artist`, `doctor`, `teacher`, `engineer`, `nurse`, `lawyer`\\n\\n## Clues:\\n1. The person who is a lawyer is somewhere to the left of the one who only drinks water.\\n2. The boba tea drinker is Alice.\\n3. Arnold is directly left of the coffee drinker.\\n4. Peter and the person who is an artist are next to each other.\\n5. Arnold is the person who is a nurse.\\n6. Carol is not in the first house.\\n7. The person who is a teacher is somewhere to the right of the person who is a doctor.\\n8. The root beer lover is somewhere to the left of the tea drinker.\\n9. The person who is a lawyer is Carol.\\n10. Bob is the one who only drinks water.\\n11. Eric is not in the fourth house.\\n12. The tea drinker is not in the sixth house.\\n13. The person who is a teacher is the root beer lover.\\n14. The one who only drinks water is somewhere to the left of Alice.\\n\",\"size\":\"6*3\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}