{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7aa024d-4795-5396-a6f8-77947502d6eb","task_key":"grid~5fmode--test--lgp~2dtest~2d3x5~2d38","task_revision_id":"1","upstream_id":"lgp-test-3x5-38","short_description":"There are 3 houses, numbered 1 to 3 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 3 houses, numbered 1 to 3 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Arnold`, `Peter`, `Eric`\\n - Each person prefers a unique type of vacation: `beach`, `mountain`, `city`\\n - Everyone has a unique favorite cigar: `prince`, `pall mall`, `blue master`\\n - Everyone has something unique for lunch: `grilled cheese`, `spaghetti`, `pizza`\\n - The people keep unique animals: `bird`, `cat`, `horse`\\n\\n## Clues:\\n1. The bird keeper is not in the second house.\\n2. The person who loves beach vacations is somewhere to the left of Arnold.\\n3. The bird keeper and the person who keeps horses are next to each other.\\n4. The bird keeper is not in the third house.\\n5. The person who is a pizza lover is not in the second house.\\n6. The person who prefers city breaks is the bird keeper.\\n7. The person who smokes Blue Master is not in the second house.\\n8. The person who loves the spaghetti eater is in the third house.\\n9. Eric is the person who smokes Blue Master.\\n10. The person who loves eating grilled cheese is directly left of the Prince smoker.\\n\",\"size\":\"3*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}