{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0cfbdb4-e4ab-5e9a-bde0-6b3d0f432ce8","task_key":"grid~5fmode--test--lgp~2dtest~2d3x5~2d2","task_revision_id":"1","upstream_id":"lgp-test-3x5-2","short_description":"There are 3 houses, numbered 1 to 3 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 3 houses, numbered 1 to 3 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Peter`, `Arnold`\\n - People have unique hair colors: `brown`, `blonde`, `black`\\n - The people keep unique animals: `cat`, `horse`, `bird`\\n - People have unique favorite music genres: `classical`, `rock`, `pop`\\n - Everyone has a favorite smoothie: `desert`, `cherry`, `watermelon`\\n\\n## Clues:\\n1. Peter is the bird keeper.\\n2. The cat lover is the person who likes Cherry smoothies.\\n3. The person who has brown hair is the Watermelon smoothie lover.\\n4. The Watermelon smoothie lover is the person who loves pop music.\\n5. Arnold is the person who has blonde hair.\\n6. The Desert smoothie lover is the person who loves classical music.\\n7. There is one house between the cat lover and the person who has blonde hair.\\n8. The person who likes Cherry smoothies is not in the third house.\\n\",\"size\":\"3*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}