{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"f58110ba-ada0-508f-9c0e-a78d51e69ff8","task_key":"grid~5fmode--test--lgp~2dtest~2d3x5~2d16","task_revision_id":"3","upstream_id":"lgp-test-3x5-16","short_description":"There are 3 houses, numbered 1 to 3 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 3 houses, numbered 1 to 3 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Arnold`, `Peter`\\n - Each person has a unique favorite drink: `milk`, `tea`, `water`\\n - People have unique favorite sports: `soccer`, `basketball`, `tennis`\\n - The people keep unique animals: `bird`, `horse`, `cat`\\n - People have unique favorite book genres: `mystery`, `science fiction`, `romance`\\n\\n## Clues:\\n1. The person who loves mystery books is the person who loves tennis.\\n2. The person who loves tennis is the tea drinker.\\n3. There is one house between the person who keeps horses and the bird keeper.\\n4. Peter is the person who likes milk.\\n5. Eric is the person who keeps horses.\\n6. The person who loves soccer is in the third house.\\n7. The person who loves science fiction books is the person who loves basketball.\\n8. The tea drinker is Arnold.\\n9. The person who likes milk is the person who loves soccer.\\n\",\"size\":\"3*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}