{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c8275115-e684-56fa-8df7-3920b7dd30f3","task_key":"grid~5fmode--test--lgp~2dtest~2d6x6~2d16","task_revision_id":"1","upstream_id":"lgp-test-6x6-16","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Bob`, `Arnold`, `Alice`, `Peter`, `Carol`, `Eric`\\n - Each person prefers a unique type of vacation: `mountain`, `city`, `cultural`, `camping`, `beach`, `cruise`\\n - Everyone has a favorite smoothie: `lime`, `desert`, `cherry`, `blueberry`, `dragonfruit`, `watermelon`\\n - People have unique favorite sports: `tennis`, `volleyball`, `basketball`, `baseball`, `swimming`, `soccer`\\n - Everyone has a unique favorite cigar: `blends`, `yellow monster`, `dunhill`, `pall mall`, `blue master`, `prince`\\n - People have unique heights: `tall`, `very tall`, `average`, `super tall`, `very short`, `short`\\n\\n## Clues:\\n1. Peter is the Prince smoker.\\n2. The person who smokes many unique blends is the person who enjoys mountain retreats.\\n3. The person who loves baseball is the person who is tall.\\n4. The person who goes on cultural tours is the person who drinks Blueberry smoothies.\\n5. The person who likes Cherry smoothies is not in the fourth house.\\n6. The person who loves soccer is the person who enjoys camping trips.\\n7. The person who is super tall is somewhere to the right of the person who likes going on cruises.\\n8. The person who drinks Blueberry smoothies is the person who is tall.\\n9. The person who is very tall is the Dunhill smoker.\\n10. The person who enjoys mountain retreats is Eric.\\n11. The person who is super tall is Alice.\\n12. Bob is the person who smokes Blue Master.\\n13. The person who loves volleyball is in the first house.\\n14. Peter and the person who drinks Lime smoothies are next to each other.\\n15. Carol is the person who likes Cherry smoothies.\\n16. Peter is the person who is short.\\n17. The person who smokes many unique blends is somewhere to the right of the Dragonfruit smoothie lover.\\n18. The person who loves swimming is Carol.\\n19. The person who is very short is the person who smokes Blue Master.\\n20. The person who loves tennis is somewhere to the left of the person who is very short.\\n21. The person who loves swimming is directly left of the person who enjoys camping trips.\\n22. The person who drinks Blueberry smoothies is not in the third house.\\n23. Alice is somewhere to the right of the person who drinks Lime smoothies.\\n24. The person who loves tennis is the person who is super tall.\\n25. The person who smokes Yellow Monster and the person who prefers city breaks are next to each other.\\n26. The Watermelon smoothie lover is the person who is very short.\\n27. The person who loves beach vacations is somewhere to the left of the person who is very tall.\\n\",\"size\":\"6*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}