{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"889688a9-c896-5645-aaf2-31a8f34ee928","task_key":"grid~5fmode--test--lgp~2dtest~2d6x4~2d14","task_revision_id":"1","upstream_id":"lgp-test-6x4-14","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Bob`, `Peter`, `Alice`, `Arnold`, `Carol`\\n - People own unique car models: `ford f150`, `honda civic`, `toyota camry`, `tesla model 3`, `chevrolet silverado`, `bmw 3 series`\\n - The mothers' names in different houses are unique: `Sarah`, `Penny`, `Holly`, `Aniya`, `Kailyn`, `Janelle`\\n - Each person has a unique hobby: `photography`, `cooking`, `knitting`, `gardening`, `woodworking`, `painting`\\n\\n## Clues:\\n1. The person who owns a Toyota Camry is in the sixth house.\\n2. Carol is the photography enthusiast.\\n3. The person who owns a Chevrolet Silverado is The person whose mother's name is Aniya.\\n4. The person who owns a Chevrolet Silverado is not in the second house.\\n5. The person who owns a Ford F-150 is The person whose mother's name is Sarah.\\n6. The person who owns a BMW 3 Series is Bob.\\n7. The person whose mother's name is Kailyn is in the sixth house.\\n8. Eric is directly left of the person who enjoys knitting.\\n9. There is one house between The person whose mother's name is Sarah and the person who owns a Toyota Camry.\\n10. The person whose mother's name is Penny is somewhere to the right of the person who enjoys knitting.\\n11. The person whose mother's name is Aniya is somewhere to the right of the person who owns a Honda Civic.\\n12. Alice is somewhere to the right of the person who owns a Ford F-150.\\n13. Eric is the person who enjoys gardening.\\n14. The woodworking hobbyist is somewhere to the left of the person who enjoys knitting.\\n15. There is one house between The person whose mother's name is Sarah and the person who loves cooking.\\n16. The person who owns a Honda Civic is Arnold.\\n17. The person whose mother's name is Holly is directly left of the person who enjoys knitting.\\n\",\"size\":\"6*4\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}