{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc69062b-3f4c-55b8-b5f5-b51f9bbc43b6","task_key":"grid~5fmode--test--lgp~2dtest~2d6x4~2d23","task_revision_id":"1","upstream_id":"lgp-test-6x4-23","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Alice`, `Arnold`, `Peter`, `Bob`, `Eric`, `Carol`\\n - Everyone has a favorite smoothie: `dragonfruit`, `cherry`, `watermelon`, `lime`, `desert`, `blueberry`\\n - Each person has a unique birthday month: `mar`, `april`, `jan`, `may`, `sept`, `feb`\\n - The people keep unique animals: `cat`, `rabbit`, `horse`, `bird`, `fish`, `dog`\\n\\n## Clues:\\n1. The bird keeper is in the third house.\\n2. The person whose birthday is in May is somewhere to the left of Eric.\\n3. Eric is the Desert smoothie lover.\\n4. The rabbit owner is the person whose birthday is in January.\\n5. The fish enthusiast is directly left of the person who likes Cherry smoothies.\\n6. The person whose birthday is in September is Peter.\\n7. There is one house between Peter and the rabbit owner.\\n8. The person who drinks Lime smoothies is not in the sixth house.\\n9. The Watermelon smoothie lover is the dog owner.\\n10. The person whose birthday is in April is somewhere to the right of Carol.\\n11. The bird keeper is somewhere to the left of the person who keeps horses.\\n12. The person who drinks Lime smoothies is Alice.\\n13. The Dragonfruit smoothie lover is directly left of Carol.\\n14. The person who drinks Blueberry smoothies is the person whose birthday is in February.\\n15. The person whose birthday is in September is in the third house.\\n16. Bob is the Dragonfruit smoothie lover.\\n17. The person who likes Cherry smoothies is somewhere to the left of the person whose birthday is in May.\\n18. The rabbit owner is the Desert smoothie lover.\\n\",\"size\":\"6*4\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}