{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d99a845-fd90-5102-b44a-fd29df2869b3","task_key":"grid~5fmode--test--lgp~2dtest~2d5x4~2d27","task_revision_id":"1","upstream_id":"lgp-test-5x4-27","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Peter`, `Alice`, `Eric`, `Bob`, `Arnold`\\n - Each person has a unique birthday month: `april`, `feb`, `mar`, `jan`, `sept`\\n - Everyone has a unique favorite cigar: `pall mall`, `prince`, `dunhill`, `blends`, `blue master`\\n - Each person has a unique favorite drink: `water`, `coffee`, `tea`, `milk`, `root beer`\\n\\n## Clues:\\n1. The root beer lover is Eric.\\n2. The person partial to Pall Mall is in the third house.\\n3. The person whose birthday is in April is Bob.\\n4. The Dunhill smoker is the person whose birthday is in March.\\n5. Peter is somewhere to the right of the root beer lover.\\n6. There is one house between the person whose birthday is in January and Peter.\\n7. The person who smokes many unique blends is the person whose birthday is in February.\\n8. The person whose birthday is in February is in the second house.\\n9. Arnold is directly left of Peter.\\n10. The person who likes milk is not in the fifth house.\\n11. The person who smokes Blue Master is the coffee drinker.\\n12. There is one house between the tea drinker and the coffee drinker.\\n13. Eric is in the third house.\\n\",\"size\":\"5*4\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}