{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4815a5bc-bc9f-50a7-b415-25da006385fd","task_key":"grid~5fmode--test--lgp~2dtest~2d5x3~2d17","task_revision_id":"1","upstream_id":"lgp-test-5x3-17","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Alice`, `Peter`, `Arnold`, `Eric`, `Bob`\\n - Everyone has a unique favorite cigar: `dunhill`, `prince`, `blue master`, `blends`, `pall mall`\\n - People have unique favorite sports: `tennis`, `soccer`, `basketball`, `swimming`, `baseball`\\n\\n## Clues:\\n1. The person who loves baseball is the person partial to Pall Mall.\\n2. The person who smokes many unique blends and Eric are next to each other.\\n3. The person who loves basketball is Peter.\\n4. Arnold is the person who loves baseball.\\n5. The person who loves basketball is somewhere to the right of the Dunhill smoker.\\n6. The person who smokes Blue Master is the person who loves tennis.\\n7. The person who loves soccer is somewhere to the right of Arnold.\\n8. Peter is in the third house.\\n9. Bob is not in the fifth house.\\n10. Alice is in the first house.\\n\",\"size\":\"5*3\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}